Answers are grounded in this paper and cite their sources.
Objectives The challenges posed by questionable journals to academia are very real, and being able to detect hijacked journals would be valuable to the research community. Using an artificial intelligence (AI) chatbot may be a promising approach to early detection. The purpose of this research is to analyze and benchmark the performance of different AI chatbots in identifying hijacked medical journals. Methods This study utilized a dataset comprising 21 previously identified hijacked journals and 10 newly detected hijacked journals, alongside their respective legitimate versions. ChatGPT, Gemini, Copilot, DeepSeek, Qwen, Perplexity, and Claude were selected for benchmarking. Three question types were developed to assess AI chatbots’ performance in providing information about hijacked journals, identifying hijacked websites, and verifying legitimate ones. Results The results show that current AI chatbots can provide general information about hijacked journals, but cannot reliably identify either real or hijacked journal titles. While Copilot performed better than others, it was not error-free. Conclusions Current AI chatbots are not yet reliable for detecting hijacked journals and may inadvertently promote them.
No takes yet. Share an insight, caveat, or question.
Hegedűs et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: