Answers are grounded in this paper and cite their sources.
BACKGROUND Longitudinal electronic health record models may support early recognition of clinical deterioration, but incomplete measurements and imprecise outcome times complicate comparisons with clinical early warning scores. OBJECTIVE This study aimed to compare longitudinal prediction models and clinical early warning scores within a model-agnostic evaluation framework that examines data completeness and outcome timing. METHODS This retrospective, single-center study used an outcome-enriched cohort comprising 264,523 eight-hour windows from 7638 episodes (7078 patients) from years 2022 to 2025. Day-discretized terminal discharge served as a death-time proxy; 24 hours was primary, 48 and 72 hours complementary, and 8 hours exploratory. Using patient-disjoint partitions and time-available predictors, we compared penalized logistic regression, gradient boosting (GBM), and random forest using engineered temporal features, a sequence Transformer, and a Transformer–GBM ensemble against adapted Modified Early Warning Score (MEWS), National Early Warning Score (NEWS), and the local VIDA early warning score. Evaluation covered discrimination, calibration, data provenance, common-support comparisons, and alert budgets. RESULTS At 24 hours, area under the receiver operating characteristic curve (AUROC) ranged from 0.852 to 0.885 across longitudinal models and from 0.607 to 0.705 for MEWS, NEWS, and VIDA; average precision (AP) ranged from 0.256 to 0.338 and from 0.073 to 0.094, respectively. GBM and the ensemble had the highest point estimates (AUROC 0.884, 95% CI 0.874-0.895, and 0.885, 95% CI 0.874-0.896; AP 0.333, 95% CI 0.304-0.366, and 0.338, 95% CI 0.309-0.371, respectively). The ensemble showed no clear gain in discrimination over GBM. Prespecified VIDA reconstruction increased episode-level availability from 4889 to 6881 without establishing equivalence to recorded scores. A phase-only 8-hour control achieved AUROC 0.833, demonstrating an endpoint-discretization artifact. CONCLUSIONS These comparisons highlight the relevance of temporal representation, measurement availability, and endpoint definition when assessing predictive performance. Representative temporal/external validation, prevalence-aware recalibration, and prospective clinical evaluation are required before clinical use.
No takes yet. Share an insight, caveat, or question.
Guillamet et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: