Assesses LLM performance on lab test interpretation, suggesting advanced AI aids diagnosis effectiveness.
Laboratory tests are crucial for diagnosing and managing health conditions, offering essential reference ranges for result interpretation. The diversity of lab tests, influenced by variables such as the specimen type (e.g., blood, urine), gender, age, and other influencing factors like pregnancy, makes automated interpretation challenging. Automated clinical decision support systems attempting to interpret these values must account for such nuances to avoid misdiagnoses or incorrect clinical decisions. In this regard, we present LabQAR ( Lab oratory Q uestion A nswering with R eference Ranges), a manually curated dataset comprising 550 lab test reference ranges derived from authoritative medical sources, encompassing 363 unique lab tests and including multiple-choice questions with annotations on reference ranges, specimen types, and other factors impacting interpretation. We also assess the performance of several large language models (LLMs), including LLaMA 3.1, GatorTronGPT, GPT-3.5 turbo, GPT-4 turbo, and GPT-4o, in predicting reference ranges and classifying results as normal, low, or high. The findings indicate that GPT-4o outperforms other models, showcasing the potential of LLMs in clinical decision support.
No takes yet. Share an insight, caveat, or question.
Bhasuran et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: