PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 11, 20260 citationsOpen Access

Memory for All: SAGE — Spatial Associative Geometric Embeddings v2

View Full Paper
ILIvelin Likov

Key Points

  • The research aims to develop a memory architecture that avoids traditional backpropagation while enhancing learning and retention in AI systems.
  • Introduced SAGE for storing knowledge as 3D geometric coordinates
  • Used cosine similarity for retrieval
  • Employed local Hebbian updates for learning
  • Demonstrated self-organising anti-collision during memory handling
  • Implemented a hippocampal-inspired consolidation pathway
  • 92% less forgetting compared to traditional neural networks
  • Achieved perfect retention across 200 continuous learning steps
  • Realized 87.2% word analogy accuracy nearing the GloVe oracle ceiling
  • Retrieval quality improved by 20.1% through Langevin dynamics
  • Demonstrated negative forgetting under noise, improving retrieval quality

Abstract

Every time an AI system needs to learn something new, it must retrain from scratch — consuming months of compute and significant resources, while still forgetting what it knew before. This paper introduces SAGE — Spatial Associative Geometric Embeddings — a memory architecture that stores knowledge as coordinate positions in a 3D geometric cube rather than in weights. Retrieval uses cosine similarity. Learning uses local Hebbian updates. No backpropagation is required at any stage. Six contributions are made: gradient-free 3D coordinate storage; self-organising anti-collision; SAGEDivided working memory with fixed spatial partition; MultiCube horizontal scaling; a hippocampal-inspired consolidation pathway; and SAGESequenceCube — explicit geometric transition memory achieving 100% rollout accuracy — all without backpropagation. Empirical results demonstrate: 92% less forgetting than neural networks (0.049 vs 0.669), 91% less than EWC; perfect retention across 200 continuous learning steps; 0.000% sparsity activation; 87.2% word analogy accuracy using two-stage retrieval across 7,096 questions — reaching 90% of the GloVe oracle ceiling (97.4%); Langevin dynamics (Force 6, V3 architecture) improves retrieval cosine similarity by 20.1%; and negative forgetting under noise — retrieval quality improves rather than degrades when noise is applied. A companion paper demonstrates SAGE powering an autonomous agent that continued operating — zero defaults across 72 steps — even when its language model was disabled. The geometry computes. The weights are not needed. Code: https://github.com/Ivelin2022/sage

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Ivelin Likov (2026) studied this question.

synapsesocial.com/papers/69d9e5d178050d08c1b75fdbhttps://doi.org/10.5281/zenodo.19483677
Ask AI
Helpful
Bookmark
Share
View Full Paper