Answers are grounded in this paper and cite their sources.
Retrospective analysis compares performance of ChatGPT-4o-latest and DeepSeek-V3-0324 in NPC, indicating AI may improve clinical decision-making.
Background Accurate tumor staging and treatment response evaluation (TRE) are critical for nasopharyngeal carcinoma (NPC) clinical decisions. Conventional methods relying on manual imaging analysis are expertise‐dependent, time‐consuming, and prone to inter‐observer variability and errors. Purpose To assess the performance of two large language models (LLMs): ChatGPT‐4o‐latest and DeepSeek‐V3‐0324 in automating T, N staging and TRE for NPC patients. Study Type Retrospective. Population Three hundred seven NPC patients from three centers (mean age: 45.5 ± 11.3 years; 216 men, 91 women). Field Strength/Sequence All imaging was conducted using 3.0T or 1.5T scanners. The imaging sequence included axial T1‐weighted fast spin‐echo, T2‐weighted fast spin‐echo, T2‐weighted fat‐suppressed spin‐echo, and Contrast‐Enhanced T1‐weighted fast spin‐echo. Assessment Two radiologists established the reference standards for TN staging at baseline and for TRE at two time points: post‐induction chemotherapy (TRE‐1) and post‐concurrent chemoradiotherapy (TRE‐2), based on the 9th version of AJCC/UICC guidelines and the RECIST1.1 criteria. LLMs were via few‐shot chain‐of‐thought prompting and tested on 277 patients with 831 reports. Additionally, four radiologists independently assessed 68 cases both with and without the assistance of LLMs and compared the performance and efficiency in both conditions. Statistical Tests McNemar–Bowker test, Wilcoxon signed–rank test. p < 0.05 was considered statistically significant. Results DeepSeek‐V3‐0324 significantly outperformed GPT‐4o‐latest in TRE‐1 staging (96.5% vs. 82.9%, p < 0.001). For T staging (95.3% vs. 93.5%, p = 0.24), N staging (93.8% vs. 89.6%, p = 0.265), and TRE‐2 (94.9% vs. 93.2%, p = 0.556), the accuracy between DeepSeek‐V3‐0324 and ChatGPT‐4o‐latest showed no significant difference. DeepSeek‐V3‐0324 also showed stronger agreement with expert annotation ( κ = 0.85–0.90), compared to ChatGPT‐4o‐latest ( κ = 0.49–0.86). Significant improvements in time efficiency were observed across all radiologists with LLM assistance ( p < 0.001). Data Conclusion LLMs, particularly DeepSeek‐V3‐0324, can automate NPC TN staging and TRE with high accuracy, enhancing clinical efficiency. LLMs integration may improve diagnostic consistency, especially for junior clinicians. Level of Evidence 3. Technical Efficacy Stage 4.
No takes yet. Share an insight, caveat, or question.
Yang et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: