A novel Dual-GAN approach jointly modeling blood volume pulse and noise distribution achieved better performance in estimating heart rate, heart rate variability, and respiration frequency from face videos compared to state-of-the-art methods.
A novel Dual-GAN approach improves the extraction of physiological signals like heart rate and respiration from face videos by jointly modeling blood volume pulse and noise.
Remote photoplethysmography (rPPG) based physiological measurement has great application values in health monitoring, emotion analysis, etc. Existing methods mainly focus on how to enhance or extract the very weak blood volume pulse (BVP) signals from face videos, but seldom explicitly model the noises that dominate face video content. Thus, they may suffer from poor generalization ability in unseen scenarios. This paper proposes a novel adversarial learning approach for rPPG based physiological measurement by using Dual Generative Adversarial Networks (Dual-GAN) to model the BVP predictor and noise distribution jointly. The BVP-GAN aims to learn a noise-resistant mapping from input to ground-truth BVP, and the Noise-GAN aims to learn the noise distribution. The two GANs can promote each other’s capability, leading to improved feature disentanglement between BVP and noises. Besides, a plug-and-play block named ROI alignment and fusion (ROI-AF) block is proposed to alleviate the inconsistencies between different ROIs and exploit informative features from a wider receptive field in terms of ROIs. In comparison to state-of-the-art methods, our approach achieves better performance in heart rate, heart rate variability, and respiration frequency estimation from face videos.
Lü et al. (Tue,) conducted a other in Remote physiological measurement. Dual Generative Adversarial Networks (Dual-GAN) with ROI alignment and fusion block vs. State-of-the-art methods was evaluated on Heart rate, heart rate variability, and respiration frequency estimation performance. A novel Dual-GAN approach jointly modeling blood volume pulse and noise distribution achieved better performance in estimating heart rate, heart rate variability, and respiration frequency from face videos compared to state-of-the-art methods.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: