PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 29, 20260 citationsOpen Access

Kolmogorov–Arnold Networks as Implicit Regularizers: Noise Robustness and Interpretability for Stellar Classification

View Full Paper
KSKristian Sestak

Key Points

  • This research aims to determine if Kolmogorov–Arnold Networks offer superior noise robustness and interpretability for stellar classification compared to existing models.
  • Compared Kolmogorov–Arnold Networks, Multi-Layer Perceptrons, and XGBoost on 100,000 SDSS DR17 objects.
  • Analyzed performance under varying signal-to-noise ratios (SNR) and conducted per-class performance analysis.
  • Investigated the role of C²-smooth B-spline activations in implicit regularization.
  • At SNR=5, KAN outperformed MLP by 9 percentage points, but a regularized MLP matched performance within 1 p.p.
  • Stars performed poorly at higher noise levels, dropping in F1 score from 0.97 to 0.75 at SNR=5, while QSOs remained stable.
  • KAN showed improved performance with specific color-index features and hybrid pipelines effectively routing low-SNR MLP predictions.

Abstract

This paper tests whether Kolmogorov–Arnold Networks (KAN 2.0) are genuinely more noise-robust than Multi-Layer Perceptrons (MLP) and XGBoost for stellar classification (star/galaxy/quasar, 100,000 SDSS DR17 objects). A naive comparison suggests so: KAN retains +9 percentage points over MLP at SNR=5. But equalizing baseline accuracy via weight decay eliminates the gap — a properly regularized MLP matches KAN to within 1 p.p. at all SNR levels, both with and without spectroscopic redshift. The same holds on an independent DESI DR1 sample with different photometric bands. KAN's robustness thus traces to implicit regularization by C²-smooth B-spline activations, not to architecture. Per-class analysis (20 trials) shows that stars degrade fastest (F1: 0.97→0.75 at SNR=5), while QSOs remain stable. KAN's native feature importance and SHAP on MLP produce different rankings (Spearman ρ=−0.37), capturing complementary aspects of the classification. Colour-index features (u−g, g−r, r−i, i−z) widen KAN's relative advantage, and a hybrid pipeline routing uncertain MLP predictions to KAN improves low-SNR accuracy. KAN is best understood as a convenient auto-regularizer whose genuine advantage is built-in interpretability.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Kristian Sestak (2026) studied this question.

synapsesocial.com/papers/6a192de6fab5b468c4416ea8https://doi.org/10.5281/zenodo.20412613
Ask AI
Helpful
Bookmark
Share
View Full Paper