Theoretical analysis reveals functional limits in unconscious artificial general intelligence, highlighting civilizational risks of human cognitive stagnation.
Current public discourse on Artificial General Intelligence (AGI)—technological unemployment anxiety, techno-utopianism, and the personification of AGI—shares an unquestioned premise: that AGI will evolve to “become more like humans” or at least “come to understand the world.” Starting from the Symbol Grounding Problem and the Hard Problem of consciousness, this paper advances the opposite working hypothesis: AGI based on the symbolic-statistical and predictive paradigm operates entirely within the human symbolic space, cannot generate qualia, and cannot directly anchor to reality. From this, the paper derives three core conclusions: AGI’s “structural lock-in,” the “blind-box regulation paradox” regarding its dependence on human creativity, and the “irreversible division of labor” between humans and AGI. The paper further argues that the most civilization-level risk in this symbiotic relationship is “civilizational lock-in”—humanity loses its creativity in excessive comfort, causing the knowledge dimension to cease growing. This paper offers no prophecy; it provides only a delineation of AGI capability boundaries under the current paradigm. The writing process of this manuscript itself constitutes a live, self-referential experiment instantiating the paper’s central thesis
No takes yet. Share an insight, caveat, or question.
Feng Yang (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: