Why the study?
Smoothing EEG power spectral density to cope with its bursty nature may cause data leakage, calling into question the performance of machine learning stress classifiers.
Does EEG-PSD smoothing in stress classification models improve true performance or cause data leakage?
Does EEG-PSD smoothing in stress classification models improve true performance or cause data leakage?
Smoothing EEG-PSD features in stress classification models may cause data leakage and artificially inflate performance, suggesting epochs should be processed individually.
May flag data leakage risk from PSD smoothing in EEG stress models; leaves open whether unsmoothed features improve validity.
Recently, multi-level stress assessment has become an active research subject. In this context, researchers typically develop models based on machine learning classifiers and features extracted from biosignals like electrocardiogram (ECG) or electroencephalogram (EEG). For that purpose, EEG power spectral density (PSD) is a recurrent feature owing to its high responsiveness and remarkable performance. However, PSD is usually smoothed to cope with its bursty nature, what may cause data leakage and hence call into question classification performance. In this study, our aim was twofold: first, to examine the effect of EEG-PSD smoothing in three-level stress classification, and second, to evaluate the practical viability of a two-level stress detector without smoothing. To this end, we conducted participants through a stress-relax session while recording their EEG. Then, we estimated the EEG-PSD and used the stress reported by the participants as labels for classification. Initially, we developed a three-level stress classifier and examined the effect of smoothing on its performance. We found that classification performance was directly proportional to smoothing intensity (F1-score 0.61–0.94), and also that when smoothing was not applied to features, classification performance was insufficient for practical applicability (AUC < 0.7). We link this behavior to train-test contamination due to smoothing. Subsequently, we attempted two-level stress classification without smoothing. In this case, performance met the criteria for practical applicability (AUC = 0.76). This suggest that performance enhancement in three-level stress classification was caused by data leakage produced by smoothing, and hence, to render realistic stress classifiers each epoch should be processed individually.
No takes yet. Share an insight, caveat, or question.
Perez‐Valero et al. (2021) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: