Deep learning has become a key approach for automated sea ice mapping in the AI4Arctic Sea Ice Challenge dataset, yet most studies focus on accuracy metrics and rarely evaluate whether predicted probabilities are reliable for operational use. This paper investigates calibration-aware training for multi-task sea ice segmentation of sea ice concentration (SIC), stage of development (SOD), and floe size (FLOE) using the U-Net model. We train the network with cross-entropy (CE) and augment the objective with focal loss, Brier loss, and an entropy-regularization term to reduce overconfidence and improve calibration. Experiments follow a scene-level Monte Carlo cross-validation protocol on the ready-to-train AI4Arctic Sea Ice Challenge dataset (AI4Arctic) dataset and are evaluated using R2 for SIC, F1 for SOD and FLOE, a weighted combined score, and expected calibration error (ECE) and reliability diagrams. Results show that calibration-aware loss functions improve test performance relative to the CE loss, and the full objective (CE + Brier + focal + entropy) achieves the highest combined score of 84.73% and reduces FLOE ECE to 0.044. Qualitative comparisons further indicate cleaner spatial structures and fewer scattered errors, particularly for FLOE. Overall, the proposed loss design improves both segmentation quality and confidence reliability, supporting more trustworthy sea ice products for decision-making.
Ahmadian et al. (Fri,) studied this question.