PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 1, 2024Pakistan Journal of Ophthalmology2 citationsOpen Access

Comparative Analysis of AI Chatbots ChatGPT, Gemini, and Copilot’s Answers to Common Cataract Questions

View Full Paper
BSBusra Guner SonmezogluHSHalil Ibrahim Sonmezoglu

Key Points

Key points are not available for this paper at this time.

Abstract

Purpose: To compare the readability and quality of the answers given by artificial intelligence (AI) chatbots to the twenty-five most frequent searches about cataracts on Google. Study Design: Cross sectional comparative study. Place and Duration of study: Serdivan State Hospital's Ophthalmology Department from March 2024 to April 2024. Methods: The word 'Cataract' was entered into Google Trends, and 25 trending searches made worldwide since 2004 were identified. These 25 trending searches were entered separately into AI programs. The answers were examined for quality using the Ensuring Quality Information for Patients (EQIP) test, while the readability was evaluated using the Flesch-Kincaid Reading Ease (FKRE) and Flesch-Kincaid Grade Level (FKGL). Results: The keywords searched most frequently were ‘Cataract surgery,’‘Eye cataract and 'After Cataract’. The EQIP category of all three AI chatbots was found to be 'serious quality issues.' When EQIP scores were compared, ChatGPT had a lower median value than Gemini and Copilot (p:0.001, p:0.007, respectively), while there was no significant difference between Gemini and Copilot (p:0.098). When FKRE values were compared, ChatGPT had a lower median value than Gemini and Copilot (p:0.001, p:0.001, respectively), with no significant difference between Gemini and Copilot (p:0.557). When FKGL values were compared, ChatGPT had a higher median value than Gemini and Copilot (p:0.003, p:0.001, respectively), with no significant difference between Gemini and Copilot(p:0.245). Conclusion: All three AI chatbots had an EQIP category of 'serious issues with quality .'The readability of all three was not at the recommended level.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Sonmezoglu et al. (2024) studied this question.

synapsesocial.com/papers/68e56113e2b3180350efdbefhttps://doi.org/10.36351/pjo.v40i4.1887
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Dr. Google vs. Dr. ChatGPT: Exploring the Use of Artificial Intelligence in Ophthalmology by Comparing the Accuracy, Safety, and Readability of Responses to Frequently Asked Patient Questions Regarding Cataracts and Cataract Surgery2024 · 65 citations
  2. 2Evaluating the Accuracy, Completeness, and Readability of Chatbot Responses to Refractive Surgery-Related Patient Questions: A Comparative Analysis of ChatGPT and Google Gemini2025 · 1 citations
  3. 3A Performance Evaluation of Large Language Model in Keratoconus: A Comparative Study of ChatGPT-3.5, ChatGPT-4.0, Gemini, Copilot, Chatsonic, and Perplexity2024 · 3 citations
  4. 4Transforming cataract care through artificial intelligence: an evaluation of large language models’ performance in addressing cataract-related queries2025 · 2 citations
  5. 5Readability and Appropriateness of Responses Generated by ChatGPT 3.5, Gemini 2.5, and Microsoft Copilot to Frequently Asked Questions About Central Serous Chorioretinopathy2026