Current large language models (LLMs) are trained primarily on human-generated text, resulting in systems that can articulate complex concepts without possessing any grounded understanding of the physical world they describe. This paper proposes a layered training paradigm — Physical-First Grounding (PFG) — inspired by the developmental sequence of human sensory and cognitive maturation. We argue that exposing AI systems to raw, unannotated physical data from scientific observatories (CERN, space telescopes, seismic networks) prior to any semantic training would produce fundamentally superior internal representations, which we term proto-embeddings. These proto-embeddings, anchored in physical invariants such as gravity, entropy, periodicity, and causality, would serve as a stable ontological foundation upon which semantic layers could later be constructed. We further propose that nodal model architectures are particularly well-suited for this paradigm, and discuss implications for both industry applications and investment in next-generation AI infrastructure.
JOANA FONSECA (Tue,) studied this question.