Preregistered evaluation reveals failed non-inferiority in context-selected LLM dormant memory, indicating the necessity of evidence-complete selection mechanisms.
H2O Dormant Memory is a falsifiable prototype that keeps provenance-bearing memory units outside an active working set until typed cues reactivate a bounded subset. Six preregistered studies evaluated the approach using synthetic or repository-derived data. Early controlled tests reduced active candidates and prompt bytes while preserving quality. The final document-transformation comparison, however, failed its preregistered non-inferiority condition: submitted prompt bytes fell from 41,232 to 5,506, but quality fell from 10/12 to 6/12 because the selector omitted critical numerical evidence and a measurement-status marker. Actual billed tokens, monetary cost, provider-side memory, and energy were not measured. The result is reported as a negative finding and a design requirement for evidence-complete, reversible context selection.
No takes yet. Share an insight, caveat, or question.
Ryoko Sakakibara (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: