Key result
Inter-subject configuration performance for PPG-based blood pressure estimation was inferior to intra-subject configuration performance across all evaluated machine learning models.
Why the study?
Previous reports estimating blood pressure from photoplethysmography showed impressive results that may be excessively optimistic due to their train/test split configuration.
Does the train/test split configuration (intra- vs inter-subject) affect the performance of blood pressure estimation algorithms using photoplethysmography?
Does the train/test split configuration (intra- vs inter-subject) affect the performance of blood pressure estimation algorithms using photoplethysmography?
Previous impressive results for blood pressure estimation from photoplethysmography may be excessively optimistic due to intra-subject data leakage, highlighting the need for proper inter-subject evaluation.
Cardiovascular diseases are the leading causes of death, and blood pressure (BP) monitoring is essential for prevention, diagnosis, assessment, and treatment. Photoplethysmography (PPG) is a low-cost opto-electronic technique for BP measurement that allows the acquisition of a modulated light signal highly correlated with BP. There are several reports of methods to estimate BP from PPG with impressive results; in this study, we demonstrate that the previous results are excessively optimistic because of their train/test split configuration. To manage this limitation, we considered intra- and inter-subject data arrangements and demonstrated how they affect the results of feature-based BP estimation algorithms (i.e., XGBoost, LightGBM, and CatBoost) and signal-based algorithms (i.e., Residual U-Net, ResNet-18, and ResNet-LSTM). Inter-subject configuration performance is inferior to intra-subject configuration performance, regardless of the model. We also showed that, using only demographic attributes (i.e., age, sex, weight, and subject index number), a regression model achieved results comparable to those obtained in an intra-subject scenario. Although limited to a public clinical database, our findings suggest that algorithms that use an intra-subject setting without a calibration strategy may be learning to identify patients and not predict BP.
No takes yet. Share an insight, caveat, or question.
Costa et al. (2023) studied Blood pressure monitoring. Inter-subject data configuration for PPG-based BP estimation vs. Intra-subject data configuration was evaluated on Algorithm performance for blood pressure estimation. Inter-subject configuration performance for PPG-based blood pressure estimation was inferior to intra-subject configuration performance across all evaluated machine learning models.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: