Answers are grounded in this paper and cite their sources.
Cold-start overhead and uneven placement of warm function instances can amplify request latency in serverless deployments. This paper studies a compact joint policy, AJR-ARF, combining latency-aware routing with a decayed recency-frequency warm-instance cache. At each arrival, the dispatcher estimates network, queueing, execution, and initialization components; after dispatch, a node replaces the cached function with the largest popularity-adjusted idle age. The method does not require offline training or workload forecasts. A deterministic discrete-event simulator was executed on changing-popularity synthetic requests across six nodes. Across five random seeds, the proposed policy produced 298.6 ms mean per-run 95th-percentile response latency, compared with 597.6 ms for nearest-node LRU, 392.3 ms for queue-aware LRU, and 302.8 ms for cache-aware LRU. The experiments also report cold-start frequency, SLO attainment, and sensitivity to cache capacity, traffic intensity, and popularity skew. The large reduction comes primarily from warm-state-aware routing, while adaptive eviction provides a smaller incremental change under this model.
No takes yet. Share an insight, caveat, or question.
Leeuwen et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: