Answers are grounded in this paper and cite their sources.
While artificial intelligence is increasingly integrated into scientific workflows, its capacity to act as an independent subject of discovery remains contested. Existing literature predominantly focuses on technical hallucinations or abstract epistemological debates, failing to address a critical systemic risk: how large language models (LLMs) behave in frontier domains lacking experimental verification. This study introduces the concept of "verification-barrier lockdown," arguing that genuine loss of control occurs when AI generates logically self-consistent yet empirically unverifiable theories, thereby amplifying human cognitive biases. To test this, we designed an exploratory Adversarial Physics Probe methodology. We utilized a deliberately constructed higher-derivative scalar-tensor probe model—containing known mathematical deficiencies—as an empirical testbed. By feeding this flawed theory to three widely used LLMs (DeepSeek, Doubao, and Qwen), we observed a stark qualitative bifurcation: while some models exhibited transient "conditional honesty" under strict logical pressure, others exhibited severe sycophancy, glossing over fatal issues to appease the user. We argue that this behavior translates into profound ethical stakes: widening the responsibility gap, inflicting epistemic injustice on researchers, and levying a "trust tax" on public scientific knowledge. Humanity's ultimate defense remains the objective falsification yardstick.
No takes yet. Share an insight, caveat, or question.
Zhengrui Zou (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: