The TURS model predicted 7-day ICU readmission with an ROC-AUC of 0.705, outperforming other rule-based models while maintaining high interpretability through five concise patient subgroup rules.
Observational (n=12,172)
No
Does the TURS machine learning model improve the prediction of ICU readmission risk compared to other rule-based models in ICU patients?
The TURS machine learning model provides an interpretable, rule-based approach to predict ICU readmission risk and identify patient subgroups with distinct characteristics.
Effect estimate: ROC-AUC 0.705 (95% CI 0.666-0.746)
OBJECTIVE: Estimating readmission risk for intensive care unit (ICU) patients is critical for clinicians to optimize resource allocation and prevent premature discharges. Machine learning models currently applied to this task either lack interpretability or cannot identify patient subgroups with distinctive readmission risks and characteristics. We addressed this gap by introducing a cutting-edge rule-based model, namely truly unordered rule sets (TURS), to reveal heterogeneous readmission risks and subgroup-level patient characteristics. MATERIALS AND METHODS: We trained TURS on all ICU admissions from January 2011 to January 2020 at Leiden University Medical Center. For each subgroup, patient characteristics and the influence of feature variables on readmission risk were analyzed. RESULTS: TURS identified subgroups with heterogeneous feature distributions and feature importance, providing actionable insights for ICU discharge planning. Its predictive performance (area under the receiver operating characteristic curve ROC-AUC 70.5%) and model complexity (5 rules, average length 2) surpassed other rule-based models. DISCUSSION: Subgroup analysis highlighted the heterogeneity of patients. First, we compared the conditional probability distribution of each feature variable, conditioned on the fact that a patient was in a certain subgroup, with its unconditional distribution. We identified features deviating from the unconditional distribution, illustrating unique subgroup-specific implications. Furthermore, we demonstrated that features with the highest impact on the readmission risk were distinctive for each subgroup. CONCLUSION: The TURS model provided a concise summary of patient subgroups, aiding ICU discharge decisions and advancing knowledge discovery in the ICU.
Yang et al. (Tue,) conducted a observational in ICU readmission (n=12,172). Truly unordered rule sets (TURS) model vs. Other rule-based and black-box machine learning models was evaluated on Predictive performance for 7-day ICU readmission (ROC-AUC) (ROC-AUC 0.705, 95% CI 0.666-0.746). The TURS model predicted 7-day ICU readmission with an ROC-AUC of 0.705, outperforming other rule-based models while maintaining high interpretability through five concise patient subgroup rules.