PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 9, 2025Proceedings of the National Academy of Sciences2 citationsOpen Access

Biologically grounded neocortex computational primitives implemented on neuromorphic hardware improve vision transformer performance

View Full Paper
AIAsim IqbalHMHassan MahmoodGSGreg J. Stuart

Key Points

  • Embedding soft winner-take-all circuits in vision transformers improves out-of-distribution generalization.
  • The circuit design demonstrated a 20% accuracy boost on unseen data across tasks.
  • Mapping biophysical models onto neuromorphic hardware shows a clear link between biological principles and AI performance.
  • This approach promotes effective learning towards salient features while minimizing computational resources.

Abstract

Understanding the computational principles of the brain and translating them into neuromorphic hardware and modern deep learning architectures is critical for advancing neuro-inspired AI (NeuroAI). Here, we develop an experimentally constrained, biophysically realistic model of neocortical microcircuits in the mouse primary visual cortex (layers 2 to 3) to examine how four major interneuron classes—Parvalbumin, Somatostatin, vasoactive intestinal peptide, and LAMP5—interact within a competitive–cooperative motif to implement soft winner-take-all (sWTA) circuit dynamics. In a conductance-based network grounded in in vitro physiology, we show that this circuit motif selectively amplifies strong inputs while suppressing, without silencing, weaker ones, enabling gain modulation, signal restoration, and context-dependent multistability. Using a gain-matching strategy, we mapped the motif onto IBM’s TrueNorth neuromorphic chip, revealing a principled correspondence between cell-type-specific roles and hardware primitives. Sparse coupling of sWTA modules generated persistent up-states and a two-state neural machine approximating working memory. We then embedded the sWTA circuit as a preprocessing filter in a Vision Transformer, which significantly enhanced out-of-distribution generalization across diverse tasks, including zero-shot digit classification, cross-domain transfer between digit datasets, and nighttime semantic segmentation. The sWTA filter boosted accuracy on unseen data by up to ~20% and reduced training compute by directing learning toward salient features, without additional data or architectural changes. By unifying biophysically grounded circuit models, neuromorphic implementation, and state-of-the-art AI architectures, this work outlines a generalizable roadmap for embedding cortical computation into next-generation NeuroAI systems that combine biological principles with practical AI performance gains.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Iqbal et al. (2025) studied this question.

synapsesocial.com/papers/68e70dab90569dd607ee5e11https://doi.org/10.1073/pnas.2504164122
Ask AI
Helpful
Bookmark
Share
View Full Paper