PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
December 21, 20250 citationsOpen Access

Anatomical Attention Alignment representation for Radiology Report Generation

View Full Paper
NVNguyễn Quang VịnhMNMinh Duc NguyenTVThanh Hoang Son Vo

Key Points

  • This research aims to improve automated radiology report generation through enhanced visual-textual understanding.
  • Proposed Anatomical Attention Alignment Network framework (A3Net) for report generation.
  • Integrated a knowledge dictionary of anatomical structures with visual features.
  • Constructed hyper-visual representations to associate image regions with anatomical entities.
  • A3Net significantly improves text generation quality in automated radiology reports.
  • Demonstrated better semantic reasoning and interpretability of generated reports.
  • Tested on IU X-Ray and MIMIC-CXR datasets with positive experimental outcomes.

Abstract

Automated Radiology report generation (RRG) aims at producing detailed descriptions of medical images, reducing radiologists' workload and improving access to high-quality diagnostic services. Existing encoder-decoder models only rely on visual features extracted from raw input images, which can limit the understanding of spatial structures and semantic relationships, often resulting in suboptimal text generation. To address this, we propose Anatomical Attention Alignment Network (A3Net), a framework that enhance visual-textual understanding by constructing hyper-visual representations. Our approach integrates a knowledge dictionary of anatomical structures with patch-level visual features, enabling the model to effectively associate image regions with their corresponding anatomical entities. This structured representation improves semantic reasoning, interpretability, and cross-modal alignment, ultimately enhancing the accuracy and clinical relevance of generated reports. Experimental results on IU X-Ray and MIMIC-CXR datasets demonstrate that A3Net significantly improves both visual perception and text generation quality. Our code is available at https: //github. com/Vinh-AI/A3NetGitHub.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Vịnh et al. (2025) studied this question.

synapsesocial.com/papers/69473b64db9c958d0dfca9e2https://doi.org/10.48550/arxiv.2505.07689
Ask AI
Helpful
Bookmark
Share
View Full Paper