PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 7, 2026Communications Biology0 citationsOpen Access

Representation Transfer via Invariant Input-driven Continuous Attractors for Fast Domain Adaptation

TXTie XuSWShengdun WuJLJunwen Luo

Key Points

  • The study aims to create a framework for quick adaptation to new tasks under domain shifts using robust representations.
  • Developed a modular framework with recurrent neural networks.
  • Pretrained modules using a task-agnostic protocol to learn transferable features.
  • Utilized invariant input-driven continuous attractor dynamics for representation learning.
  • Validated the framework on gesture and rehabilitation action recognition tasks.
  • Achieved competitive accuracy compared to state-of-the-art methods, particularly in few-shot scenarios.
  • Reduced parameter requirements by an order of magnitude compared to traditional methods.
  • Showed resilience to domain shifts and temporal perturbations.

Abstract

Conventional end-to-end deep neural networks often degrade under domain shifts and require costly retraining when deployed in unpredictable, noisy environments. Inspired by biological brains, we propose a modular framework where each module is a recurrent neural network pretrained via a simple, task-agnostic protocol to learn robust, transferable features. This shapes stable yet flexible low-dimensional representations as invariant input-driven continuous attractor manifolds embedded in high-dimensional latent space across different tasks, supporting robust transfer and resilience to temporal perturbations. At deployment, only a lightweight adapter needs training, allowing rapid adaptation to new tasks. Validated on gesture and rehabilitation action recognition tasks, our framework achieves accuracy competitive with state-of-the-art methods, especially in few-shot settings, while requiring an order of magnitude fewer parameters and minimal training. By integrating biologically inspired attractor dynamics with cortical-like modular composition, the framework offers a practical path toward robust, continual adaptation in real-world information processing.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Xu et al. (2026) studied this question.

synapsesocial.com/papers/69d49f1cb33cc4c35a227946https://doi.org/10.1038/s42003-026-09938-8
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Inducing Inductive Bias in Vision Transformer for EEG Classification2024 · 8 citations
  2. 2Domain randomization for transferring deep neural networks from simulation to the real world2017 · 2,908 citations
  3. 3Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication2004 · 3,878 citations
  4. 4Towards Out-Of-Distribution Generalization: A Survey2021 · 236 citations
  5. 5Breaking Neural Network Scaling Laws with Modularity2024 · 1 citations