Synapse
⌘+K
Synapse
PulseExploreClubsResearchersJournals
Instagram
HomeClubsExplore
September 15, 2026Machine Learning and Knowledge ExtractionOpen Access

A Gradient-Level Diagnosis of Extreme Class Imbalance in Multiple Instance Learning via q-Calculus

View Full Paper
Ask AI
Bookmark
Share

Authors

ARArif Ali RehmanEBEnrique Nava BaroPOPablo Otero

Discussion

Loading...

Member takes

Overview

Machine learning study reveals loss reweighting degrades multiple instance learning under extreme imbalance, indicating performance bottlenecks stem from representations rather than optimizers.

Key Points

  • Investigate optimization limits and gradient dynamics under extreme class imbalance (1:251) in weakly supervised multiple instance learning using digital breast tomosynthesis.
  • Evaluated attention-based pooling over frozen EfficientNet-B3 features across 20 random seeds on digital breast tomosynthesis data under a 1:251 bag-level class imbalance.
  • Tested loss-surface interventions (focal loss, asymmetric loss, class-balanced loss) against unweighted binary cross-entropy (BCE) and a novel q-calculus gradient modification utilizing the Jackson q-derivative.
  • All loss-reweighting methods monotonically degraded classification performance compared to unweighted BCE, defining an empirical performance floor at an AUPRC of 0.055.
  • Q-calculus gradient smoothing matched vanilla BCE performance (p=0.632, Cohen's d=0.003) and established an optimization ceiling at an AUPRC of 0.0912 while reducing gradient variance.
  • Focal loss produced severe model miscalibration with an expected calibration error (ECE) > 0.44, compared to 0.036 for unweighted BCE.

Cite This Study

Rehman et al. (2026) studied this question.

synapsesocial.com/papers/6aa913ba9013453be30a1c8dhttps://doi.org/10.3390/make8090282
View Full Paper
Ask AI
Bookmark
Share