Boosting Deep Learning for Interpretable Brain MRI Lesion Detection through the Integration of Radiology Report Information

Lisong Dai; Jiayu Lei; Fenglong Ma; Zheng Sun; Haiyan Du; Houwang Zhang; Jianyong Wei; Dan Wang; Guang Tan; X Z Song; Jinyu Zhu; Qianqian Zhao; Songtao Ai; Ai Shang; Zhaohui Li; Ya Zhang; Y S Li

doi:10.1148/ryai.230520

October 8, 2024Radiology Artificial IntelligenceOpen Access

Boosting Deep Learning for Interpretable Brain MRI Lesion Detection through the Integration of Radiology Report Information

View Full Paper

Ask AI

Bookmark

Share

Key Points

To determine whether integrating textual features extracted from radiology reports improves deep learning performance and interpretability for detecting brain lesions on MRI scans.
Trained a multimodal deep learning model incorporating radiology report-derived textual features alongside brain MR images.
Compared diagnostic classification across 14 brain diseases and normal brain scans against a baseline deep learning model trained without textual data, assessing interpretable attention maps.
The multimodal deep learning model incorporating report-derived text features outperformed the baseline image-only model in identifying normal brain status and 14 distinct brain diseases.
The integrated model successfully generated interpretable attention maps detailing lesion localization on MR images.

Ask about this paper

Answers are grounded in this paper and cite their sources.

Implication

Computational study demonstrates improved detection across 14 brain diseases on MRI using radiology text features, indicating enhanced model accuracy and interpretability.

Abstract

A deep learning model incorporating radiology report–derived textual features outperformed a basic deep learning model trained without textual features in identifying 14 brain diseases and normal brain on MR images while providing interpretable attention maps.

Discussion

No takes yet. Share an insight, caveat, or question.

Cite This Study

Dai et al. (2024) studied this question.

synapsesocial.com/papers/6a87e50102f504243ce96c97 https://doi.org/10.1148/ryai.230520

View Full Paper

Ask AI

Bookmark

Share

Boosting Deep Learning for Interpretable Brain MRI Lesion Detection through the Integration of Radiology Report Information

Key Points

Ask about this paper

Implication

Abstract

Discussion

Cite This Study

Boosting Deep Learning for Interpretable Brain MRI Lesion Detection through the Integration of Radiology Report Information

Key Points

Ask about this paper

Implication

Abstract

Discussion

Cite This Study

Keep reading

Keep reading