PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 18, 2026Journal of King Saud University - Computer and Information Sciences0 citationsOpen Access

Adaptive multi-embedding fusion via denoising bidirectional mamba for sequential recommendation

TZTongfei ZengQWQuan WenYHYi Huang

Key Points

  • The aim is to enhance sequential recommendation systems by improving prediction accuracy and robustness against noise.
  • Developed an adaptive semantic-collaborative fusion module integrating item semantic and collaborative embeddings.
  • Introduced selective frequency modulation within a bidirectional Mamba encoder for noise reduction.
  • Constructed an end-to-end framework using gated linear units for feature enhancement and prediction.
  • Achieved 1.02%-11.76% improvements in Hit@10 metrics compared to existing models.
  • Demonstrated 2.84%-7.57% increases in NDCG@10 across multiple datasets, indicating stronger performance especially in sparse scenarios.
  • Ablation studies revealed GLU improves performance by 2.2%-5.2% across datasets.

Abstract

Sequential recommendation aims to predict users’ next interactions based on their historical behavior. However, existing models suffer from three major limitations: (1) reliance solely on collaborative filtering signals while overlooking item semantic information; (2) vulnerability to high-frequency noise in behavior sequences, which interferes with representation learning; and (3) computational inefficiency in Transformer-based bidirectional architectures. To address these challenges, we propose AFNBM (Adaptive Fusion via Noise-filtered Bidirectional Mamba), a novel framework that introduces three key innovations. First, we develop an adaptive semantic-collaborative fusion module that leverages pre-trained language models to extract item semantic embeddings and integrates them with collaborative embeddings through learnable parameters and. This mechanism effectively mitigates data sparsity and cold-start problems. Second, we integrate selective frequency modulation (SFM) into a bidirectional Mamba encoder, making this the first work to combine frequency-domain adaptive denoising with state space models (SSMs) for sequential recommendation. The bidirectional encoder captures temporal dependencies in both directions during training while the Mamba blocks themselves maintain linear complexity O (L). Each Mamba block incorporates an SFM layer with learnable parameter, enabling adaptive control over high-frequency component retention. The SFM operation introduces an O (L L) factor, making the overall framework complexity O (L L), which remains significantly more efficient than Transformer-based models with O (L^2) complexity while simultaneously improving computational efficiency and noise robustness. Third, we construct a comprehensive end-to-end framework built upon the adaptive fusion and bidirectional Mamba-SFM architecture. For prediction, we employ a gated linear unit (GLU) to selectively enhance salient features, followed by a masked-terminal prediction layer. Extensive experiments validate the effectiveness of our design: ablation studies quantify each component’s contribution (e. g. , GLU yields +2. 2% to +5. 2% gains across datasets), while AFNBM achieves 1. 02%-11. 76% improvements in Hit@10 and 2. 84%-7. 57% improvements in NDCG@10 over state-of-the-art baselines across four benchmark datasets, with particularly strong results on sparse and cold-start scenarios.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Zeng et al. (2026) studied this question.

synapsesocial.com/papers/69ba43a84e9516ffd37a50e0https://doi.org/10.1007/s44443-026-00562-4
Ask AI
Helpful
Bookmark
Share
View Full Paper