PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 1, 20260 citationsOpen Access

SINAI team at NTCIR-18 RadNLP 2024

View Full Paper
MDManuel-Carlos Díaz-GalianoLMLucas Molino-PiñarÁAÁlvaro Herrera Arjonilla

Key Points

  • This research aims to enhance performance in the NTCIR-18 RadNLP 2024 tasks using advanced NLP techniques.
  • Utilized large language models for the main task
  • Implemented data augmentation and retrieval-augmented generation
  • Employed ModernBERT model with pre-training for the subtask
  • Conducted hyperparameter optimization
  • Achieved 0.5309% overall joint accuracy in the main task
  • Obtained 0.8189% overall micro F2.0 score in the subtask
  • Identified that data augmentation further improved model performance

Abstract

This paper presents our participation in the NTCIR-18 RadNLP 2024 English main task and subtask. We describe our proposed solution to address the problem and discuss the official results. Our approach is based on large language models, with additional experiments involving data augmentation, retrieval-augmented generation, and prompting for the main task. Additionally, for the subtask, we employed a ModernBERT model with pre-training and hyperparameter optimization. Our best-performing submission in the main task, scores 0.5309\% in overall joint accuracy (fine) evaluation. Also, our best-performing submission in the subtask, scores 0.8189\% in overall micro F2.0 evaluation. Results from additional runs also show that data augmentation could further improve model performance beyond our best submission.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Díaz-Galiano et al. (2025) studied this question.

synapsesocial.com/papers/69cd7a915652765b073a7e13https://doi.org/10.20736/0002002074
Ask AI
Helpful
Bookmark
Share
View Full Paper