What question did this study set out to answer?

To evaluate the mathematical properties, informativeness, and interpretability of R-squared compared to SMAPE, MSE, RMSE, MAE, and MAPE for assessing regression models.

July 5, 2021SHILAP Revista de lepidopterologíaOpen Access

The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation

View Full Paper

Ask AI

Bookmark

Authors

DCDavide ChiccoUniversity of Toronto MWMatthijs J. WarrensUniversity of Groningen GJGiuseppe JurmanFondazione Bruno Kessler

Discussion

Member takes

Implication

Comparative analysis demonstrates superior interpretability of R-squared over SMAPE and standard error metrics across datasets, suggesting its adoption as a standard evaluation metric.

Key Points

To evaluate the mathematical properties, informativeness, and interpretability of R-squared compared to SMAPE, MSE, RMSE, MAE, and MAPE for assessing regression models.
Analyzed the mathematical formulation and theoretical limitations of unbounded error metrics (MSE, RMSE, MAE, MAPE) and bounded metrics (R-squared, SMAPE).
Benchmarked R-squared against SMAPE across multiple synthetic benchmark use cases and two real-world medical regression datasets.
R-squared provided higher informativeness and fidelity relative to ground-truth distribution performance compared to SMAPE.
Demonstrated that R-squared avoids the interpretability drawbacks inherent to unbounded metrics like MSE, RMSE, MAE, and MAPE.

Cite This Study

Chicco et al. (2021) studied this question.

synapsesocial.com/papers/69d75f1eb4cef8fedc48fb0c https://doi.org/10.7717/peerj-cs.623

View Full Paper

Ask AI

Bookmark

Implication

Comparative analysis demonstrates superior interpretability of R-squared over SMAPE and standard error metrics across datasets, suggesting its adoption as a standard evaluation metric.

The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation

Discussion

Member takes

Implication

Key Points

Cite This Study

The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation

Discussion

Member takes

Implication

Key Points

Cite This Study

Also Consider

Also Consider