Answers are grounded in this paper and cite their sources.
Root Mean Square Error (RMSE) and Kling-Gupta Efficiency (KGE) are widely used performance metrics for quantifying the mismatch between simulated and observed data. They can be expressed in terms of three components: mean error, anomaly amplitude error, and anomaly similarity error. This decomposition makes it possible to identify the primary error source affecting overall model performance. However, the RMSE does not vary monotonically with model performance, which may mislead the evaluation results, while KGE is insensitive to anomaly similarity error, especially when the correlation coefficient value is high. To address these shortcomings, we proposed a novel error-decomposition index, termed the Decomposable Error Index (DEI), for measuring overall model error. The DEI is built from individual penalty terms that target mean, anomaly amplitude, and anomaly similarity errors. When the other two errors are held constant, the DEI varies monotonically with each of these three errors, thereby avoiding the non-monotonic limitation of RMSE. Moreover, the DEI imposes stronger penalties on the anomaly similarity error than KGE does. The DEI error decomposition statistically identifies the primary error source of the overall model error and pinpoints the primary driver for the inter-model performance difference. Beyond the evaluation of a scalar field, we also extended DEI and its decomposition into vector or multivariate fields. Applying DEI and its decomposition to evaluate CMIP models over East Asia, we identified the anomaly similarity error as the primary source of the overall performance for precipitation and multi-level winds across 26 CMIP6 models in both winter and summer, explaining 42–99 % of DEI2. It underscores the priority of improving pattern similarity for their simulations in future model development. Specifically, the pattern similarity improvement in wind and summer precipitation can significantly benefit from enhancing the horizontal resolution. In evaluating generational progress of 13 CMIP5-6 model pairs, the DEI decomposition pinpoints the reduced anomaly similarity error (mean error) as the key driver responsible for the improved overall performance of multi-level wind simulations in winter and summer (multi-level air temperature simulation in summer) over this region, with over 53 % contribution.
No takes yet. Share an insight, caveat, or question.
Zhang et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: