Evaluating Density Forecasts Using Weighted Multivariate Scores in a Risk Management Context

Scoring rules are commonly applied to assess the accuracy of density forecasts in both univariate and multivariate settings. In a financial risk management context, we are mostly interested in a particular region of the density: the (left) tail of a portfolio’s return distribution. The dependence structure between returns on different assets (associated with a given portfolio) is usually time-varying and asymmetric. In this paper, we conduct a simulation study to compare the discrimination ability between the well-established scores and their threshold-weighted versions with selected regions. This facilitates a comprehensive comparison of the performance of scoring rules in different settings. Our empirical applications also confirm the importance of weighted-threshold scores for accurate estimates of Value-at-risk and related measures of downside risk.