Answers are grounded in this paper and cite their sources.
AbstractAI models using medical images are increasingly proposed to support clinical decision-making in lung cancer, motivating assessment of their methodological rigor and transparency. To assess how these models are developed, evaluated, and reported, and to identify gaps in best statistical practices, we conducted a cross-sectional meta-research review of OpenAlex-indexed studies (January 1, 2023, to June 30, 2025) that developed image-based AI tools for lung cancer risk prediction, detection, or prognosis. Thirty-six studies met our inclusion criteria. Convolutional neural networks were used in most studies (27 studies, 75%), and area under the curve (AUC) was the most frequently reported evaluation metric (29 studies, 81%). Although 23 studies (64%) reported some form of uncertainty quantification, most were limited to presenting confidence intervals for global performance metrics (e.g., AUC, sensitivity, and accuracy) rather than individual prediction- or risk-level uncertainty. Common limitations included limited external test set use (14 studies, 39%), insufficient subgroup analyses (10 studies, 28%), and limited adherence to established prediction-model reporting guidelines. Overall, future research should prioritize standardized reporting, use of external test sets, and model performance assessment across clinically relevant subpopulations. The coexistence of increasingly powerful AI-based prediction models with inconsistent study design, evaluation, and reporting practices emphasizes the urgent need to implement more rigorous and transparent methodological standards in this field. (Funded by Yale School of Public Health.).
No takes yet. Share an insight, caveat, or question.
Hou et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: