Clinical Validation of a Deep Learning Algorithm for Automated Coronary Artery Disease Detection and Classification Using a Heterogeneous Multivendor Coronary Computed Tomography Angiography Data Set

Purpose: We sought to clinically validate a fully automated deep learning (DL) algorithm for coronary artery disease (CAD) detection and classification in a heterogeneous multivendor cardiac computed tomography angiography data set. Materials and Methods In this single-centre retrospective study, we included patients who underwent cardiac computed tomography angiography scans between 2010 and 2020 with scanners from 4 vendors (Siemens Healthineers, Philips, General Electrics, and Canon). Coronary Artery Disease–Reporting and Data System (CAD-RADS) classification was performed by a DL algorithm and by an expert reader (reader 1, R1), the gold standard. Variability analysis was performed with a second reader (reader 2, R2) and the radiologic reports on a subset of cases. Statistical analysis was performed stratifying patients according to the presence of CAD (CAD-RADS >0) and obstructive CAD (CAD-RADS ≥3). Results Two hundred ninety-six patients (average age: 53.66 ± 13.65, 169 males) were enrolled. For the detection of CAD only, the DL algorithm showed sensitivity, specificity, accuracy, and area under the curve of 95.3%, 79.7%, 87.5%, and 87.5%, respectively. For the detection of obstructive CAD, the DL algorithm showed sensitivity, specificity, accuracy, and area under the curve of 89.4%, 92.8%, 92.2%, and 91.1%, respectively. The variability analysis for the detection of obstructive CAD showed an accuracy of 92.5% comparing the DL algorithm with R1, and 96.2% comparing R1 with R2 and radiology reports. The time of analysis was lower using the DL algorithm compared with R1 ( P < 0.001). Conclusions The DL algorithm demonstrated robust performance and excellent agreement with the expert readers' analysis for the evaluation of CAD, which also corresponded with significantly reduced image analysis time.