Key result
An artificial neural network model accurately predicted acute kidney injury, bleeding, death, and any adverse outcome after percutaneous coronary intervention, showing significantly higher AUC, IDI, and NRI compared to currently used regression models.
Why the study?
Existing risk models for predicting complications after PCI are limited by accuracy and an inability to use non-linear relationships among predictors.
Does an artificial neural network (ANN) model improve the prediction of acute kidney injury, bleeding, stroke, and death compared to existing regression models in patients undergoing PCI?
Cross-Sectional (n=28,005)
Yes
Does an artificial neural network (ANN) model improve the prediction of acute kidney injury, bleeding, stroke, and death compared to existing regression models in patients undergoing PCI?
Effect estimate: AUC improvement of 1.6% - 5.6%
Artificial neural network models significantly improve the prediction of major adverse events (AKI, bleeding, death) after PCI compared to traditional regression models.
May improve post-PCI risk prediction; leaves open prospective validation before clinical adoption.
Importance Complications after percutaneous coronary intervention (PCI) are common and costly. Risk models for predicting the likelihood of acute kidney injury (AKI), bleeding, stroke and death are limited by accuracy and inability to use non-linear relationships among predictors. Additionally, if non-linear relationships among predictors can be leveraged, then the prediction of any adverse event (i.e. “the patient who will not do well with PCI”) is perhaps of greater interest to clinicians than prediction of adverse events in isolation. Objective To develop and validate a set of artificial neural networks (ANN) models to predict five adverse outcomes after PCI – AKI, bleeding, stroke, death and one or more of these four (‘any adverse outcome’). Design Cross-sectional study, using institutional NCDR CathPCI data. Setting and participants 28,005 patients undergoing PCI at five hospitals in the Barnes-Jewish Hospital system. Main Outcome(s) AKI, bleeding, stroke, death, and one or more of these four (‘any adverse outcome’). We divided 28,005 PCI patients into a training cohort of 21,004 (75%) and a test cohort of 7,001 (25%). We used an artificial neural network (ANN) multilayer perceptron (MLP) model to predict each outcome based on a set of 278 encoded and preprocessed variables. Model accuracy was tested using area under the receiver-operating-characteristic curve (AUC). Performance and validation of the MLP model was compared with existing regression models using integrated discrimination improvement (IDI) and continuous net reclassification index (NRI). Results The prevalence of AKI, bleeding, stroke and death in the study cohort was 4.6%, 3.6%, 0.3% and 1.1%, respectively. The fully trained MLP model achieved convergence quickly (< 10 epochs) and could predict accurately predict AKI (77.9%), bleeding (86.5%), death (90.3%) and any adverse outcome (80.6%) in the independent test set. However, prediction of stroke was not satisfactory (69.9%). Compared to the currently used models for AKI, bleeding and death prediction, our models showed a significantly higher AUC (range 1.6% – 5.6%), IDI (range 4.9% –7.2%) and NRI (range 0.07 – 0.61). Conclusions and Relevance By using neural network-based models, we accurately predict major adverse events after PCI. Larger studies for replicability and longitudinal studies for evidence of impact are needed to establish these artificial intelligence methods in current PCI practice.
No takes yet. Share an insight, caveat, or question.
Kulkarni et al. (2020) conducted a cross-sectional in Patients undergoing percutaneous coronary intervention (PCI) (n=28,005). Artificial neural network (ANN) multilayer perceptron (MLP) model vs. Currently used regression models was evaluated on Prediction of adverse outcomes (AKI, bleeding, stroke, death, and any adverse outcome) measured by AUC (AUC improvement of 1.6% - 5.6%). An artificial neural network model accurately predicted acute kidney injury, bleeding, death, and any adverse outcome after percutaneous coronary intervention, showing significantly higher AUC, IDI, and NRI compared to currently used regression models.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: