Answers are grounded in this paper and cite their sources.
We consider the problem of identifying inaccurate default probability estimates in credit rating systems. Since the validation of these estimates usually entails performing multiple tests, there is an increased risk of erroneously dismissing correctly calibrated default probabilities. We use multiple-testing procedures to control this risk of committing type-I errors as measured by the family-wise error rate (FWER) and the false discovery rate for finite sample sizes. For the FWER, we also consider procedures that take possible discreteness of the data (and the test statistics) into account. The performance of these methods is illustrated in a simulation setting and for empirical default data. The results show that both types of multiple-testing procedure can serve as helpful tools for identifying inaccurate estimates while maintaining a predefined level of type-I error.
No takes yet. Share an insight, caveat, or question.
Sebastian Döhler (2010) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: