The proposed spatial-temporal deep learning framework for remote photoplethysmography achieved highly accurate contactless heart rate estimation, with a Mean Absolute Error of 0.75 bpm on the UBFC-rPPG dataset and 0.73 bpm on the PURE dataset.
Deep learning-based remote photoplethysmography (rPPG) offers a promising contactless method for physiological monitoring in telemedicine, though challenges like motion artifacts, lighting, and skin tone bias must be addressed.
Effect estimate: MAE 0.75 bpm
Over the last ten years, telemedicine has undergone significant developments, from simple communication-based healthcare to smart and data-driven solutions. The solutions are now powered by Artificial Intelligence (AI), Machine Learning (ML), and Internet of Medical Things (IoMT) technologies. Physiological monitoring is traditionally done with contact-based sensors. The sensors include Electrocardiogram (ECG) and pulse oximeters. The sensors have various disadvantages, including hardware costs, difficulty in continuous usage, and discomfort for patients. Photoplethysmography (rPPG), a remote method of physiological monitoring, is a breakthrough technology. The method is used to estimate physiological signals, including Heart Rate (HR), from video streams captured by standard RGB cameras. The paper aims to explore spatial-temporal deep learning frameworks for remote rPPG as part of a standard five-layer telemedicine architecture. We explain a general ML pipeline, along with the benefits of decomposing the spatial and temporal features of images and motion to improve signal extraction against environmental noise. Besides, the paper presents some of the deployment issues, which include motion effects, lighting, as well as bias in the algorithms, specifically with respect to melanin absorption in human skin. The research also presents some of the avenues of future research, specifically with respect to model compression, which will help move from a cloud to an edge device, thus helping to improve the privacy of users.
Vũ et al. (Sun,) conducted a other in Heart rate estimation (n=52). Spatial-temporal deep learning framework for remote photoplethysmography (rPPG) vs. Other state-of-the-art rPPG algorithms was evaluated on Mean Absolute Error (MAE) of heart rate estimation (MAE 0.75 bpm). The proposed spatial-temporal deep learning framework for remote photoplethysmography achieved highly accurate contactless heart rate estimation, with a Mean Absolute Error of 0.75 bpm on the UBFC-rPPG dataset and 0.73 bpm on the PURE dataset.