AI Chatbot Showdown in News Fact Checking: Exploring Automated Verification in the Greek Media Landscape

The circulation of non-true stories in digital media environments presents ongoing challenges for journalism and fact-checking. The development of artificial intelligence has led to the use of AI chatbots in content verification processes. This study evaluates the performance of AI chatbot systems in identifying non-true stories within the Greek media context. A quantitative comparative research design was applied, using claims previously assessed by professional fact-checking organizations. Chatbot responses were compared with established verification verdicts to examine detection accuracy, variation across categories of non-true stories, and differences related to source characteristics. The results indicate that AI chatbots demonstrate measurable capability in identifying non-true stories, while also exhibiting limitations in specific content categories, particularly those involving complex or AI-generated material. Performance differences between chatbot systems suggest that design characteristics and task orientation influence verification outcomes. The findings support the view that AI-based tools function most effectively as components of broader verification processes in which human judgment remains essential.