Why the study?
Existing end-to-end rPPG and heart rate measurement methods from facial videos are vulnerable to less-constrained scenarios such as head movement and bad illumination.
Answers are grounded in this paper and cite their sources.
AutoHR provides a robust neural architecture search-based method for remote heart rate measurement from facial videos, overcoming limitations of existing methods in unconstrained scenarios.
Remote photoplethysmography (rPPG), which aims at measuring heart activities without any contact, has great potential in many applications (e.g., remote healthcare). Existing end-to-end rPPG and heart rate (HR) measurement methods from facial videos are vulnerable to the less-constrained scenarios (e.g., with head movement and bad illumination). In this letter, we explore the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong end-to-end baseline (AutoHR) for remote HR measurement with neural architecture search (NAS). The proposed method includes three parts: 1) a powerful searched backbone with novel Temporal Difference Convolution (TDC), intending to capture intrinsic rPPG-aware clues between frames; 2) a hybrid loss function considering constraints from both time and frequency domains; and 3) spatio-temporal data augmentation strategies for better representation learning. Comprehensive experiments are performed on three benchmark datasets, and we achieved superior performance on both intra- and cross-dataset testings.
No takes yet. Share an insight, caveat, or question.
A 2020 study studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: