This study aimed to evaluate the diagnostic performance of a deep learning-based algorithm for detecting acute ischemic stroke (AIS), including small infarcts, on non-contrast computed tomography (NCCT). A retrospective, multi-reader, pivotal, crossover, randomized study involving 917 cases was conducted to validate the performance of an artificial intelligence (AI) algorithm. NCCT images were independently reviewed by nine readers categorized into three subgroups (three non-radiologist physicians, three board-certified radiologists, and three neuroradiologists), both with and without the assistance of the AI algorithm. In standalone analysis, the AI model achieved an area under the receiver operating characteristic curve of 0.8144, with an accuracy of 73.8%, sensitivity of 75.8%, and specificity of 72.6%. AI-assisted brain CT interpretation showed higher diagnostic accuracy than AI-unassisted interpretation (75.63% vs. 72.03%, with improvement of 3.60%, p < 0.001). Among the three subgroups of reviewers, non-radiologist physicians showed the greatest improvement in diagnostic accuracy with AI assistance compared with without AI assistance (75.35% vs. 69.97%, with improvement of 5.38%, p < 0.001). Our results suggested that AI-assisted interpretation can improve diagnostic performance in the detection of AIS on NCCT across a range of infarct volumes and reader expertise levels. Its integration into clinical workflows could facilitate more timely and equitable AIS diagnosis.
Yun et al. (Sun,) studied this question.