Why the study?
Deep learning approaches are needed to address challenges such as motion artifacts, redundancy, and external noise in contactless video-based remote photoplethysmography signal extraction.
STREAM-Net provides a robust and reliable deep learning approach for non-invasive, video-based extraction of physiological signals like blood volume pulse.
Answers are grounded in this paper and cite their sources.
Should not yet change contactless monitoring practice; extends video rPPG networks but leaves open prospective clinical validation.
Remote photoplethysmography (rPPG) has become a popular, non-invasive, contactless technique for detecting physiological signals with promising applications. The latest advancements employ deep learning to address the challenges, including motion artifacts, redundancy, and external noise in video-based rPPG signal extraction. To this end, we propose a bilateral spatio-temporal network for estimating blood volume pulse (BVP) signals by analyzing human physiological processes through video frames. The spatio-temporal branches leverage lateral attention and multi-scale feature integration to enhance the extraction of rPPG signals. The spatio-temporal lateral attention module integrates spatial-temporal features at higher and lower resolutions to preserve essential dependency between spatial and temporal data at different scales. Whereas, the multi-scale feature enhancement module encodes high-level features to refine spatial features further with distinct local and global representations. We conducted extensive experiments to validate the effectiveness and superior performance of the proposed method on two benchmark datasets. In cross-dataset validation, STREAM-Net achieved MAE accuracy of 1.151 and RMSE of 2.715 on the UBFC dataset, whereas MAE accuracy of 1.318 and MAPE of 1.384 on the PURE dataset. Cross-dataset testing on both benchmarks demonstrates the efficacy of our proposed approach. Given the importance of repeatability and reliability in clinical measurements, we also quantified predictive uncertainty of our model using Monte Carlo dropout. This analysis exhibited the robust performance and high repeatability of the proposed model, with uncertainty variance ranging from 0.0049 to 0.0113 across different dropout rates. The source code is publicly available at https://github.com/usmanraza121/STREAM-Net .
No takes yet. Share an insight, caveat, or question.
Sobotka et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: