Journal of Risk Model Validation
ISSN:
1753-9579 (print)
1753-9587 (online)
Editor-in-chief: Steve Satchell
![Risk.net](https://www.risk.net/sites/default/files/styles/print_logo/public/2018-09/print-logo.png?itok=1TpHrpuP)
Discriminatory power: an obsolete validation criterion?
Manuel Lingo, Gerhard Winkler
Abstract
ABSTRACT
In this paper we analyze two common measures of discriminatory power, the accuracy ratio and the area under the receiver operator characteristic, in a probabilistic framework. Under the assumption of a random default event, we verify that the measures will be portfolio dependent, as discovered by Hamerle et al (2003), and furthermore stochastic, as indicated by Blochwitz et al (2005). As an extension we first study how the structure of a portfolio influences the measures. Furthermore we demonstrate that the measures contain information about a rating system’s calibration quality. To this end a testing procedure is developed that also allows for a comparison of the measures across different portfolios. Our analysis leads to the final conclusion that high granularity and good calibration quality are sufficient to maximize attainable discriminatory power and are thus the sole criteria to be considered in any validation exercise.
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@risk.net
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@risk.net