Key result
The intrinsic surgical risk score performed better than the PRAm score for predicting 30-day mortality in paediatric patients, though both yielded many false positives.
Why the study?
The study was conducted to externally validate and recalibrate two patient-specific risk scores for 30-day in-hospital mortality in paediatric patients: the Pediatric Risk Assessment score and the intrinsic surgical risk score.
Do the PRAm and intrinsic surgical risk scores accurately predict 30-day in-hospital mortality in paediatric patients?
Observational (n=606,488)
Yes
Do the PRAm and intrinsic surgical risk scores accurately predict 30-day in-hospital mortality in paediatric patients?
While the intrinsic surgical risk score outperformed the PRAm score for predicting 30-day mortality in pediatric patients, both scores had high false positive rates and offered limited clinical benefit over ASA physical status alone.
Answers are grounded in this paper and cite their sources.
External validation shows limited accuracy and high false positives; leaves open need for refined pediatric perioperative mortality models.
BACKGROUND: Risk prediction scores are used to guide clinical decision-making. Our primary objective was to externally validate two patient-specific risk scores for 30-day in-hospital mortality using the Multicenter Perioperative Outcomes Group (MPOG) registry: the Pediatric Risk Assessment (PRAm) score and the intrinsic surgical risk score. The secondary objective was to recalibrate these scores. METHODS: Data from 56 US and Dutch hospitals with paediatric caseloads were included. The primary outcome was 30-day mortality. To assess model discrimination, the area under the receiver operating characteristic curve (AUROC) and area under the precision-recall curve (AUC-PR) were calculated. Model calibration was assessed by plotting the observed and predicted probabilities. Decision analytic curves were fit. RESULTS: The 30-day mortality was 0.14% (822/606 488). The AUROC for the PRAm upon external validation was 0.856 (95% confidence interval 0.844-0.869), and the AUC-PR was 0.008. Upon recalibration, the AUROC was 0.873 (0.861-0.886), and the AUC-PR was 0.031. The AUROC for the external validation of the intrinsic surgical risk score was 0.925 (0.914-0.936) and AUC-PR was 0.085. Upon recalibration, the AUROC was 0.925 (0.915-0.936), and the AUC-PR was 0.094. Calibration metrics for both scores were favourable because of the large cluster of cases with low probabilities of mortality. Decision curve analyses showed limited benefit to using either score. CONCLUSIONS: The intrinsic surgical risk score performed better than the PRAm, but both resulted in large numbers of false positives. Both scores exhibited decreased performance compared with the original studies. ASA physical status scores in sicker patients drove the superior performance of the intrinsic surgical risk score, suggesting the use of a risk score does not improve prediction.
No takes yet. Share an insight, caveat, or question.
Tangel et al. (2024) conducted an observational in Paediatric patients requiring surgery (n=606,488). Pediatric Risk Assessment (PRAm) score and intrinsic surgical risk score was evaluated on 30-day in-hospital mortality (AUROC 0.925, 95% CI 0.914-0.936). The intrinsic surgical risk score performed better than the PRAm score for predicting 30-day mortality in paediatric patients, though both yielded many false positives.
Synapse has enriched 10 related papers. Consider them for comparative context: