The novel deep learning approach improved heart rate variability estimation accuracy to a correlation index score of 0.917, significantly better than existing methods.
Does a transformer-based deep neural network improve the accuracy of noncontact heart rate and heart rate variability estimation from camera videos compared to traditional methods?
A novel transformer-based deep learning approach using two-stage training improves the accuracy of noncontact heart rate and heart rate variability estimation from camera videos.
Absolute Event Rate: 0% vs 0%
ABSTRACT Background Studies have shown that heart rate variability (HRV) is a predictor of the prognosis of cardiovascular diseases. Contact heartbeat monitoring equipment is widely used, especially in hospitals, and benefits from the rapidity and accuracy of the detection of physiological health indicators. However, long‐term contact with equipment has many adverse effects. The purpose of this study was to improve the accuracy of HRV detection via noncontact equipment, thus enabling HRV to be assessed in various scenarios. Methods A novel deep learning approach was proposed for measuring heartbeats through camera videos. First, we performed facial segmentation and divided the face into 16 grid cells with different light balance scores. After the trend is filtered by the Hamming window, a transformer‐based neural network is used to further filter the signal. Finally, heart rate (HR) and HRV are estimated. Results We used 1 million synthetic data points for pretraining and a public dataset in combination with a dataset that we constructed for task training. The final results were obtained on a test dataset that we constructed. The accuracy for HR with a low light balance score (0.867–0.983) was greater than that with a high score (0.667–0.750). Our method had higher accuracy in estimating HR than traditional filtering methods (0.167–0.417) and state‐of‐the‐art neural network filtering methods (0.783–0.917) did. The root mean square error of the HRV from the time domain was the lowest, and the correlation index score was the highest for the HRV from the frequency domain estimated by our method compared with those estimated by two neural networks. Conclusions Light balance, large sample training, and two‐stage training can improve the accuracy of HRV estimation.
Lan et al. (Thu,) reported a other. The novel deep learning approach improved heart rate variability estimation accuracy to a correlation index score of 0.917, significantly better than existing methods.