PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 20, 20250 citationsOpen Access

A Robust Multi-Scale Framework with Test-Time Adaptation for sEEG-Based Speech Decoding

View Full Paper
SWSuli WangYLYang Yang LiSCSiqi Cai

Key Points

  • The proposed framework enhances robustness in speech decoding using sEEG signals, improving performance.
  • Evaluation on the DU-IN benchmark showed superior results against state-of-the-art models, particularly in tough scenarios.
  • The framework integrates a multi-scale approach with online test-time adaptation for effective speech signal modeling.
  • These findings suggest the framework can support more reliable BCI systems in diverse applications.

Abstract

Decoding speech from stereo-electroencephalography (sEEG) signals has emerged as a promising direction for brain-computer interfaces (BCIs). Its clinical applicability, however, is limited by the inherent non-stationarity of neural signals, which causes domain shifts between training and testing, undermining decoding reliability. To address this challenge, a two-stage framework is proposed for enhanced robustness. First, a multi-scale decomposable mixing (MDM) module is introduced to model the hierarchical temporal dynamics of speech production, learning stable multi-timescale representations from sEEG signals. Second, a source-free online test-time adaptation (TTA) method performs entropy minimization to adapt the model to distribution shifts during inference. Evaluations on the public DU-IN spoken word decoding benchmark show that the approach outperforms state-of-the-art models, particularly in challenging cases. This study demonstrates that combining invariant feature learning with online adaptation is a principled strategy for developing reliable BCI systems. Our code is available at https://github.com/lyyi599/MDM-TENT.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Wang et al. (2025) studied this question.

synapsesocial.com/papers/68f5fcce8d54a28a75cf1cc1https://doi.org/10.48550/arxiv.2509.24700
Ask AI
Helpful
Bookmark
Share
View Full Paper