Skip to content

Reduce run blob LRU cache from 2048 to 256#346

Merged
ptrlrd merged 1 commit into
mainfrom
fix/reduce-run-cache
May 23, 2026
Merged

Reduce run blob LRU cache from 2048 to 256#346
ptrlrd merged 1 commit into
mainfrom
fix/reduce-run-cache

Conversation

@ptrlrd
Copy link
Copy Markdown
Owner

@ptrlrd ptrlrd commented May 23, 2026

Summary

  • Backend container at 3GB/7.8GB on the droplet (90% memory pressure)
  • The _load_run_blob LRU cache holds up to 2048 full run JSON blobs in memory
  • At ~500KB per blob, that's ~1GB of cache alone
  • Reduce to 256 entries (~128MB) -- still plenty for hot share links

At ~500KB per blob, 2048 entries could hold ~1GB in memory. The
backend container is at 3GB/7.8GB on the droplet. 256 entries is
plenty for hot share links while cutting cache memory ~8x.
@ptrlrd ptrlrd merged commit 871735c into main May 23, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant