Applying differential privacy (epsilon=10) to the original ResNet-SE model reduced macro-average AUC from 0.90 to 0.79, but reducing model size by 98.4% mitigated this drop, achieving an AUC of 0.87.
Reducing model complexity in deep learning ECG classifiers significantly improves the privacy-utility trade-off when applying differential privacy, preserving high diagnostic accuracy while protecting patient data.
Absolute Event Rate: 0.79% vs 0.9%
This study investigates how differential privacy (DP) can enhance data confidentiality in deep learning models for predicting cardiovascular diseases (CVDs) using electrocardiography (ECG) data collected from various hospitals. We evaluated the privacy–utility trade-off by analyzing model performance under different privacy budgets ( ϵ ) across different model architectures, including the high-capacity ResNet with squeeze-and-excitation (ResNet-SE), transformer-based model, and two simple baselines: logistic regression (LR) and multilayer perceptrons (MLP). The original ResNet-SE model, with 8.81 million parameters, showed substantial performance degradation under DP with macro- and micro-average AUCs decreasing from 0.90 and 0.92 to 0.79 and 0.82 at ϵ = 10 . By reducing the model size by 98.4% to 142,934 parameters, we achieved a better balance between accuracy and privacy, with macro- and micro-average AUCs of 0.87 and 0.89, only 0.03 lower than its non-private performance. The transformer-based model showed weaker robustness to DP, with a macro- and micro-average AUCs dropping from 0.88 and 0.91 to 0.64 and 0.73, while LR and MLP baselines trained on ECG handcrafted features achieved low performance even without privacy. The effect of training with DP varied across classes, having only minimal impact on the four largest classes (AUC reduction ≤ 0.01), but more substantial performance decreases were observed for many of the smaller classes (e.g. 0.10 drop for a condition with a 1.19% class size, and a drop of 0.28 for condition with class size of 3.10%). Overall, our study demonstrates the positive effect of reducing model complexity for improving privacy-utility trade-off for predicting CVDs. • We study DP in deep learning ECG classifiers to ensure patient data privacy. • Large models show significant performance drops under DP. • Reducing model complexity improves the privacy-utility trade-off. • DP has minimal impact on largest cardiovascular diseases but impacts rarer ones more.
Orabe et al. (Mon,) conducted a other in Cardiovascular diseases (n=103,019). Differential privacy (epsilon=10) in ResNet-SE model vs. No differential privacy was evaluated on Macro-average AUC. Applying differential privacy (epsilon=10) to the original ResNet-SE model reduced macro-average AUC from 0.90 to 0.79, but reducing model size by 98.4% mitigated this drop, achieving an AUC of 0.87.