Key result
XGBoost outperforms rule-based models in predicting 30-day pneumonia readmissions with an AUROC of ~0.66.
Why the study?
Hospital readmissions for pneumonia are a growing concern in the US with significant consequences for costs and quality of care, prompting the need to predict 30-day readmission risk.
Do machine learning models accurately predict 30-day all-cause readmission in adults hospitalized with pneumonia?
Observational (n=372,293)
Yes
Do machine learning models accurately predict 30-day all-cause readmission in adults hospitalized with pneumonia?
Machine learning models, particularly XGBoost, demonstrated moderate predictive performance for 30-day readmission in pneumonia patients, identifying consistent risk factors such as illness severity and comorbidities.
Machine learning offers only marginal gains for pneumonia readmission prediction; leaves open clinical utility pending prospective validation.
BACKGROUND: Hospital readmissions for pneumonia are a growing concern in the US, with significant consequences for costs and quality of care. This study developed the rule-based model and other machine learning (ML) models to predict 30-day readmission risk in patients with pneumonia and compared model performance. METHODS: This population-based study involved patients aged ≥ 18 years hospitalized with pneumonia from January 1, 2016, through November 30, 2016, using the Healthcare Cost and Utilization Project-National Readmission Database (HCUP-NRD). Rule-based algorithms and other ML algorithms, specifically decision trees, random forest, extreme gradient descent boosting (XGBoost), and Least Absolute Shrinkage and Selection Operator (LASSO), were used to model all-cause readmissions 30 days post-discharge from index pneumonia hospitalization. A total of 61 clinically relevant variables were included for ML model development. Models were trained on randomly partitioned 50% of the data and evaluated using the remaining dataset. Model hyperparameters were tuned using the ten-fold cross-validation on the resampled training dataset. The area under the receiver operating curves (AUROC) and area under precision-recall curves (AUPRC) were calculated for the testing set to evaluate the model performance. RESULTS: Of the 372,293 patients with an index hospital hospitalization for pneumonia, 48,280 (12.97%) were readmitted within 30 days. Judged by AUROC in the testing data, rule-based model (0.6591) significantly outperformed decision tree (0.5783, p value < 0.001), random forest (0.6509, p value < 0.01) and LASSO (0.6087, p value < 0.001), but was less superior than XGBoost (0.6606, p value = 0.015). The AUPRC of the rule-based model in the testing data (0.2146) was higher than the decision tree (0.1560), random forest (0.2052), and LASSO (0.2042), but was similar to XGBoost (0.2147). The top risk-predictive rules captured by the rule-based algorithm were comorbidities, illness severity, disposition locations, payer type, age, and length of stay. These predictive risk factors were also identified by other ML models with high variable importance. CONCLUSION: The performance of machine learning models for predicting readmission in pneumonia patients varied. The XGboost was better than the rule-based model based on the AUROC. However, important risk factors for predicting readmission remained consistent across ML models.
No takes yet. Share an insight, caveat, or question.
Huang et al. (2022) conducted an observational in Pneumonia (n=372,293). XGBoost machine learning model vs. Rule-based ensemble model was evaluated on Area under the receiver operating curve (AUROC) for 30-day all-cause readmission (95% CI 0.657-0.6641, p=0.015). The XGBoost model significantly outperformed the rule-based model in predicting 30-day hospital readmission among pneumonia patients, achieving an AUROC of 0.6606 compared to 0.6591 (p=0.015).
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: