Answers are grounded in this paper and cite their sources.
Abstract Remote Photoplethysmography (rPPG) is a method for non-contact estimation of heart rate (HR) using facial video. In comparison to traditional electrocardiography (ECG), which requires physical contact and may cause discomfort to the subjects, rPPG technology offers a more comfortable and convenient solution. This is particularly applicable to patients such as newborns who find it challenging to wear monitoring devices, thereby reducing the risk of infections associated with contact devices.In recent years, Remote Photoplethysmography (rPPG) technology based on deep learning methods has advanced rapidly. Currently, most models use Convolutional Neural Networks (CNN) as feature extractors. However, the spatiotemporal perception capacity of CNN has certain limitations, potentially leading to the oversight of crucial information.Therefore, we propose a network with enhanced spatiotemporal awareness, named SWM. SWM employs Swin Transformer blocks as feature extractors, and after differencing and normalizing the video sequence, it enters Wrapping Temporal Shift Modules (WTSM).We proposed a subsampling method named Patch WTSM Mask, which facilitates the interaction of contextual information and weights facial features. SWM demonstrates excellent performance on the UBFC-rPPG dataset, with MAE=0.49, RMSE=1.21, MAPE=0.54, Pearson=0.99. The robustness of SWM is further validated across datasets, specifically on the UBFC-Phys dataset, where MAE=6.10, RMSE=10.82, MAPE=7.22, Pearson=0.70.In the end, we conducted ablation experiments and compared SWM with advanced methods, confirming its outstanding performance. SWM no longer relies on CNN, potentially heralding a new direction in the research field of rPPG.The data and code used in this study can be found at {https://github.com/tannixi/SWM}, and each record has a corresponding DOI: [10.5281/zenodo.11487732].
No takes yet. Share an insight, caveat, or question.
Zhao et al. (2024) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: