Answers are grounded in this paper and cite their sources.
This analysis reveals outdated information in language models for Indian contexts, suggesting a need for better evaluation methods.
Most work on LLM reliability focuses on hallucination, which refers to models generating confident but false information. This paper identifies and characterizes a related but distinct failure mode: temporal knowledge asymmetry, where models provide correct information for one geographic context but outdated information for a structurally equivalent question about another context. I evaluated three frontier LLMs (Claude Opus 4.1, Gemini 3, and ChatGPT 5.1) using a matched-pair question bank of 500 items across six knowledge domains. Contrary to my initial hypothesis, outright hallucination rates were statistically similar between Indian and Western questions (India 1.7% vs. West 1.6% averaged across models). However, I found a consistent pattern of temporal lag in Indian institutional knowledge: models gave outdated answers for Indian current affairs at rates up to 9.6 percentage points higher than for equivalent Western questions. For both Claude Opus 4.1 and Gemini 3, the outdated-answer rate for Indian current affairs was 8% while the rate for equivalent Western positions was 0%. This asymmetry was consistent across all three independently developed models, suggesting a systemic cause rooted in training data composition rather than any single model's design. I propose temporal accuracy as a necessary additional evaluation dimension for LLM benchmarks targeting equitable global deployment.
No takes yet. Share an insight, caveat, or question.
Parth Anand (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: