ChatGPT improved readability of patient information texts without reaching a 6th-grade level, whereas Google Bard achieved the 6th-grade level but omitted up to 83% of the content.
Do ChatGPT and Google Bard improve the readability of written patient information?
Large language models like ChatGPT can improve the readability of patient information materials, though achieving specific grade levels without content loss remains challenging.
Patient information materials often tend to be written at a reading level that is too advanced for patients. In this proof-of-concept study, we used ChatGPT and Google Bard to reduce the reading level of three selected patient information sections from scientific journals. ChatGPT successfully improved readability. However, it could not achieve the recommended 6th-grade reading level. Bard reached the reading level of 6th graders but oversimplified the texts by omitting up to 83% of the content. Despite the present limitations, developers of patient information are encouraged to employ large language models, preferably ChatGPT, to optimize their materials.
Moons et al. (2023) studied this question. ChatGPT and Google Bard was evaluated on Reading level. ChatGPT improved readability of patient information texts without reaching a 6th-grade level, whereas Google Bard achieved the 6th-grade level but omitted up to 83% of the content.