PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 22, 20260 citationsOpen Access

Learning Systems and Innate Behavior

View Full Paper
LMLucas Meyer

Key Points

  • This research explores how innate motivations can drive continuous learning in artificial intelligence systems.
  • Constructed a reinforcement-learning prototype in 2019 focusing on 'pain and pleasure' as a reward signal.
  • Analyzed large language models' architecture for flexibility and learning during their operational lifespan.
  • Outlined a research program for developing smaller, adaptive models with stakes.
  • Proposed that current models lack the capability for lifelong learning driven by innate internal states.
  • Demonstrated that flexibility in transformer architectures could serve as a foundation for continuous learning.
  • Identified an open gap in developing smaller models that adapt during their lifespan.

Abstract

Most contemporary work on artificial agents — including the current generation of large language model agents — treats motivation as something to be specified at runtime, and treats learning as something that ends at deployment. We argue that what makes a creature feel alive is not the sophistication of its behavior but the presence of innate stakes: internal states it did not choose, cannot disable, and must work to keep within viable ranges. For humans, physical stress is a canonical example. And what enables a creature to grow into its own intelligence is not a finished pretrained model, but an architecture that keeps learning from its own innate experience, driven by those stakes. We ground the argument in a working 2019 reinforcement-learning prototype — with documentation framing the reward signal as "pain and pleasure" — and we argue that the transformer and recent LLM architectures are the first ones flexible enough to play the role of a generalized training mass at initialization. Combining these two observations gives a concrete research vision: smaller models that learn during their lifespan, in receptacles that have something at stake, rather than ever-larger scaling of models on internet data. As of mid-2026, this gap remains open. We sketch the implementation path, a four-direction research program, and the direction we intend to explore.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Lucas Meyer (2026) studied this question.

synapsesocial.com/papers/6a0ff3ffd674f7c03778cf35https://doi.org/10.5281/zenodo.20301638
Ask AI
Helpful
Bookmark
Share
View Full Paper