Analysis reveals machine learning outperforms large language models for entities, suggesting improved methods for text extraction.
In this paper, we delve into the techniques used to extract information from medical texts written in Spanish. Our study focuses on fine-tuning Large Language Models by training them on Spanish medical texts and adjusting various hyperparameters. We also explore traditional machine learning algorithms like support vector machines, decision trees, and nearest neighbours. Our analysis aims to evaluate the tool's ability to identify entities and relationships between them. Our results show that the support vector machine algorithm outperformed Large Language Models in entity identification, achieving a 78.72% F1 score compared to 68.04%. However, Large Language Models demonstrated superior performance in relationship identification, achieving a 57.15% F1 score compared to 35.5% for machine learning algorithms.
No takes yet. Share an insight, caveat, or question.
Reyes‐Ortiz et al. (2025) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: