A novel adaptive knowledge distillation framework utilizing short-form videos effectively captured physiological signal fluctuations across three benchmark datasets.
A novel adaptive knowledge distillation framework improves the accuracy of video-based remote physiological measurement using short-form videos.
Video-based remote physiological measurement, enabling non-contact monitoring of physiological signals through facial videos, demonstrates promising prospects in remote medicine and health monitoring. To take advantage of long-term dependency information from cardiac activity, previous methods commonly rely on long video sequences for measurement. These approaches are highly susceptible to various internal and external factors and struggle to capture fluctuations in physiological signals over extended measurement periods reliably. Unlike previous long-form video-based methods, we propose a novel adaptive knowledge distillation framework that utilizes short-form videos. This approach aims to mitigate the impact of internal and external factors while accurately capturing physiological signal fluctuations by reducing the required video length for precise measurement. Specifically, we first propose a long-short-term distillation framework that uses a teacher model to capture long-term dependencies from long-form videos and leverages this capability to guide the training of the student model on short-form videos. Subsequently, we propose a frame-level dynamic prior mechanism (FDPM) that replaces student features similar to teacher features with the corresponding teacher features and dynamically adjusts their proportions. Furthermore, we design an instance adaptive distillation mechanism (IADM) module that dynamically regulates the distillation temperature and the loss weight to develop an optimal distillation strategy for each sample. Finally, we conduct systematic experiments across three benchmark datasets and various video lengths. Experimental results demonstrate the effectiveness of our method, especially in short-form video scenarios.
Zhang et al. (Wed,) conducted a other in remote physiological measurement. adaptive knowledge distillation framework vs. long-form video-based methods was evaluated on measurement accuracy across three benchmark datasets. A novel adaptive knowledge distillation framework utilizing short-form videos effectively captured physiological signal fluctuations across three benchmark datasets.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: