You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Hot ingestion: minimum optimization to fit the Phase 2 budget #974
Phase 2 (1 s block time) gives ingestion 405 ms p99 per ledger. Hot ingestion on feature/full-history must stay under that for a whole 10,000-ledger chunk. Currently we're able to fit within that budget on small 500-1000 ledgers run, but fail when we run on the full chunk.
Problem
Full-length Phase 2 runs on the sac-5000 profile miss the budget. Runs capped at 1,000 hot ledgers pass, so the pass was an artifact of the cap.
Same commit, box type and dataset. The other five ingest phases do not change. The growth is in apply: ConcurrentBitmaps.AddTo clones each dense term's roaring bitmap on every write, and the clone cost grows with the number of containers as the chunk fills. Every published run since July shows the same dependence on hot-leg length.
Work
Confirm the cause: per-phase breakdown of both runs, sweep of all 28 published runs, local reproduction on synthetic ledgers.
Make dense terms writer-owned and publish reader snapshots lazily. stellar-rpc#973.
Activity