Answers are grounded in this paper and cite their sources.
Qualitative study reveals Chinese-trained models outperform English models on Chinese medical exams, indicating training data differences drive benchmark performance.
At the current level, LLMs trained primarily on English corpora and those trained mainly on Chinese corpora perform similarly well in CNMLE, with Chinese models still outperforming. The performance difference between ChatGPT and other Chinese LLMs are not solely due to communication barriers but are more likely influenced by disparities in the training data. By using a method of cross-verification with multiple LLMs, excellent performance can be achieved in medical examinations.
No takes yet. Share an insight, caveat, or question.
Yao et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: