PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
June 4, 2026IEEE Transactions on Image Processing5 citations

Spatial Temporal Self-Compensating Graph Convolutional Network for Skeleton-Based Action Recognition under Data Constraints

View Full Paper
LXLi XQGQiang GengQHQian Huang

Key Points

  • The aim is to enhance skeleton-based action recognition techniques under data constraints such as missing frames and occlusion.
  • Developed a Spatial Temporal Self-compensating Graph Convolutional Network (STSc-GCN) with two key modules: Collaborative Motion Spatial Compensation and Meta-action Sharpening Temporal Compensation.
  • Utilized distinct topological relationships to explore collaborative relationships between joints to address spatial data limitations.
  • Implemented cross-attention technology to enhance dynamic information within meta-action sequences.
  • Achieved state-of-the-art performance on four constrained datasets, showcasing significant improvements in action recognition accuracy.
  • Demonstrated superior results on three widely used standard datasets, confirming effectiveness across both constrained and typical scenarios.

Abstract

Skeleton-based human action recognition has emerged as a prominent research focus in computer vision, with significant progress achieved in recent years. However, existing methods often suffer substantial performance degradation under real-world data constraints, such as body occlusion, missing frames, and noise. These limitations critically undermine the robustness of related techniques in practical applications. To address these challenges, we propose a Spatial Temporal Self-compensating Graph Convolutional Network (STSc-GCN), which skillfully utilizes the systematic and regular nature of human movement to mitigate performance degradation caused by data constraints through a data self-compensation mechanism. Specifically, STSc-GCN comprises two key modules: 1) Collaborative Motion Spatial Compensation (CMSC). This module designs multiple distinct topological relationships, primarily including Walk-probability Generality Topology and Self-organizing Particularity Topology, respectively, to deeply explore the universal and personalized collaborative relationships between human joints. These relationships help compensate for the lack of information caused by spatial data constraints. 2) Meta-action Sharpening Temporal Compensation (MSTC). This module introduces a novel motion sharpening mechanism that enhances key dynamic information within the meta-action sequences through cross-attention technology, thereby improving model adaptability to missing-frame scenarios. STSc-GCN achieves state-of-the-art performance on four constrained datasets and shows superior results on three widely used standard datasets, confirming its effectiveness in both constrained and general scenarios. Code will be available at https://github.com/XingLi1012/STSc-GCN.git.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

X et al. (2026) studied this question.

synapsesocial.com/papers/6a211549d499ed480b16e788https://doi.org/10.1109/tip.2026.3695673
Ask AI
Helpful
Bookmark
Share
View Full Paper