PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 8, 2026Infectious Disease Modelling0 citationsOpen Access

Retrospective Evaluation of Trained and Untrained Probabilistic Ensemble Forecasts for Influenza Hospital Admissions — United States, 2022–2025

View Full Paper
AFAaron M. FrutosAHAnnabella HinesLSLi Shandross

Key Points

  • This evaluation aims to assess the accuracy of trained ensemble methods for forecasting influenza hospital admissions.
  • Retrospective analysis of ensemble forecasts from the 2022-2025 influenza seasons.
  • Comparison of trained ensembles to untrained ensembles using past performance data.
  • Forecasts based on influenza hospital admission data from CDC's National Healthcare Safety Network.
  • Trained ensemble forecasts consistently outperformed untrained ensembles in all evaluated seasons.
  • Performance varied across jurisdictions, with the best model differing each season.
  • Multiple trained ensembles showed improved prediction interval coverage compared to untrained ensembles.

Abstract

The United States Centers for Disease Control and Prevention (CDC) coordinates influenza forecasting efforts with approximately 30 academic and industry teams and combines their short-term, weekly forecasts into an ensemble forecast to improve accuracy and increase utility. To investigate the accuracy of trained ensemble methods for forecasting confirmed influenza hospital admissions, we retrospectively compared ensembles trained on past forecast performance of submitting teams during the 2022–23, 2023–24, and 2024–25 influenza seasons to the untrained ensemble used during each season. Forecasts are based on laboratory-confirmed influenza hospital admission data from CDC’s National Healthcare Safety Network. For each week from October 2022–April 2023, October 2023–April 2024, and November 2024–May 2025, we produced three trained median and three trained mean ensembles that weight individual forecasts based on their weighted interval score (WIS) during the prior 2, 4, or 6 weeks of performance. We evaluated the trained and untrained ensembles using prediction interval coverage and the WIS. Compared to the untrained ensemble, multiple trained ensemble performed better in each season and across jurisdictions, although the best performing ensemble differed. As this is an analysis of only three influenza seasons, we will continue to evaluate ensemble performance over subsequent seasons to see if consistent patterns emerge in the performance of different methods to train ensembles.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Frutos et al. (2026) studied this question.

synapsesocial.com/papers/69d5f00974eaea4b11a79800https://doi.org/10.1016/j.idm.2026.04.002
Ask AI
Helpful
Bookmark
Share
View Full Paper