PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 23, 2025Electronics4 citationsOpen Access

Subset-Aware Dual-Teacher Knowledge Distillation with Hybrid Scoring for Human Activity Recognition

View Full Paper
YPYoung‐Jin ParkHCHui‐Sup Cho

Key Points

  • Recognition accuracy improved significantly with dual-teacher knowledge distillation and tailored teacher models.
  • The method utilized cross-entropy loss combined with knowledge transfer to enhance robustness across various activities.
  • An evaluation on benchmarks like UCF101 and HMDB51 was conducted, proving the effectiveness of the proposed framework.
  • Practical implications include enhancements for real-world applications, particularly in healthcare and surveillance settings.

Abstract

Human Activity Recognition (HAR) is a key technology with applications in healthcare, security, smart environments, and sports analytics. Despite advances in deep learning, challenges remain in building models that are both efficient and generalizable due to the large scale and variability of video data. To address these issues, we propose a novel Dual-Teacher Knowledge Distillation (DTKD) framework tailored for HAR. The framework introduces three main contributions. First, we define static and dynamic activity classes in an objective and reproducible manner using optical-flow-based indicators, establishing a quantitative classification scheme based on motion characteristics. Second, we develop subset-specialized teacher models and design a hybrid scoring mechanism that combines teacher confidence with cross-entropy loss. This enables dynamic weighting of teacher contributions, allowing the student to adaptively balance knowledge transfer across heterogeneous activities. Third, we provide a comprehensive evaluation on the UCF101 and HMDB51 benchmarks. Experimental results show that DTKD consistently outperforms baseline models and achieves balanced improvements across both static and dynamic subsets. These findings validate the effectiveness of combining subset-aware teacher specialization with hybrid scoring. The proposed approach improves recognition accuracy and robustness, offering practical value for real-world HAR applications such as driver monitoring, healthcare, and surveillance.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Park et al. (2025) studied this question.

synapsesocial.com/papers/68f9d6583f3788722249264bhttps://doi.org/10.3390/electronics14204130
Ask AI
Helpful
Bookmark
Share
View Full Paper