Fail closed is success here.The original conversation stays intact instead of accepting a checkpoint with a missing tail.
One word. Two mechanisms.
Moves or compresses KV-cache state so a request can run.
No Session checkpointReplaces older durable history with a complete structured summary.
Committed checkpointTrace the rejected attempt.
compaction/start8192 / 8192MAX_TOKENSsurface unchangedChoose the binding boundary.
output = 8192Raise summary capTry 16,384 and measure one attempt.
small model driftsRoute a summarizerSet provider and model together.
overflow stays hiddenExpose server overflowDecide whether Harness owns context recovery.
retries repeatStart cleanCarry a bounded handoff, not the full log.
The cap to change
- id: compaction-basic
config:
maxTokens: 16384Not the conversation output cap. Not the context window.Twelve acceptance gates.
- Context shift stays distinct.
- Purpose is compaction.
- Route pair resolves.
- Default cap is visible.
- MAX_TOKENS maps.
- No partial summary lands.
- Surface stays intact.
- Error closes durably.
- Success records three events.
- Retries mean convergence.
- Triggers stay distinct.
- Clean handoff stays bounded.