Key result
The proposed 3D temporal central difference convolutional attention network with Huber loss outperformed prior state-of-the-art methods for remote heart rate estimation, achieving a Pearson's correlation coefficient higher than 0.96 across three public datasets.
Why the study?
Features learned by deep learning models for remote photoplethysmography are vulnerable to motion and illumination artefacts and fail to fully exploit intrinsic temporal characteristics.
An efficient spatiotemporal modeling-based rPPG recovery method using 3D central difference convolution and Huber loss achieves highly accurate contactless measurement of cardiac and respiratory signals.
Contactless physiological signal measurement has great applications in various fields, such as affective computing and health monitoring. Physiological measurements based on remote photoplethysmography (rPPG) are realized by capturing the weak periodic color changes. The changes are caused by the variation in the light absorption of skin surface during systole and diastole stages of a functioning heart. This measurement mode has advantages of contactless measurement, simple operation, low cost, etc. In recent years, several deep learning-based rPPG measurement methods have been proposed. However, the features learned by deep learning models are vulnerable to motion and illumination artefacts, and are unable to fully exploit the intrinsic temporal characteristics of the rPPG. This paper presents an efficient spatiotemporal modeling-based rPPG recovery method for physiological signal measurements. First, two modules are utilized in the rPPG task: 1) 3D central difference convolution for temporal context modeling with enhanced representation and generalization capacity, and 2) Huber loss for robust intensity-level rPPG recovery. Second, a dual branch structure for both motion and appearance modeling and a soft attention mask are adapted to take full advantage of the central difference convolution. Third, a multi-task setting for joint cardiac and respiratory signals measurements is introduced to benefit from the internal relevance between two physiological signals. Last, extensive experiments performed on three public databases show that the proposed method outperforms prior state-of-the-art methods with the Pearson's correlation coefficient higher than 0.96 on all three datasets. The generalization ability of the proposed method is also evaluated by cross-database and video compression experiments. The effectiveness and necessity of each module are confirmed by ablation studies.
No takes yet. Share an insight, caveat, or question.
Zou et al. (2024) studied Healthy subjects (physiological signal measurement) (n=92). 3D temporal central difference convolutional attention network with Huber loss vs. Prior state-of-the-art rPPG methods was evaluated on Heart rate estimation accuracy (Mean Absolute Error, Root Mean Square Error, Pearson's correlation coefficient). The proposed 3D temporal central difference convolutional attention network with Huber loss outperformed prior state-of-the-art methods for remote heart rate estimation, achieving a Pearson's correlation coefficient higher than 0.96 across three public datasets.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: