“Hallucinations” of artificial intelligence tools misleading patients and families

A BSTRACT Large Language Models offer significant benefits in healthcare, including guidance for patients and families. One of the risks associated with these tools is the presentation of inaccurate information, known as “Hallucinations.” This study highlights three cases where these tools misled patients and families by providing false information, which could cause harm. Therefore, physicians must review and verify any Artificial intelligence (AI)-generated content, as these tools cannot reliably differentiate between accurate and false information.