Preprint shows cost optimization in LLM sessions using a rent-or-buy model, suggesting improved efficiency.
This paper shows that the LLM session restart decision under prompt-caching APIs is structurally identical to the Economic Order Quantity (EOQ) and ski-rental models, yielding a 41.4% upper bound on timing-addressable cost and a closed-form regret function. Includes the paper PDF, reconstruction scripts, and billing data for reproducibility. This is a preprint. A version will be submitted to arXiv.
No takes yet. Share an insight, caveat, or question.
L Q Cheng (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: