Comparing Patient Perception and Physician’s Records: Generative AI Performance Evaluation

Patient perception involves a patient’s thoughts and beliefs regarding their health status. It is also associated with medical compliance and outcomes. However, discrepancies often arise between patient perception and physicians’ documentation within the medical records, resulting in misunderstanding and suboptimal doctor-patient communication. In this study, we assessed the efficacy of generative artificial intelligence (AI) in comparing the content of patient perception as recorded in patient questionnaires and physicians’ records of the Department of Breast Surgery. We evaluated the precision and recall of the generative AI by comparison with human-created ground truth. Our results demonstrated the high performance of the generative AI in comprehending and contrasting symptoms and the entire content recorded differently by patients and physicians, with F1 scores ranging from 0.77 to 0.97. These results highlight the potential contribution of a generative AI to deeper mutual comprehension in healthcare scenarios.