Journal of Risk Model Validation
ISSN:
1753-9579 (print)
1753-9587 (online)
Editor-in-chief: Steve Satchell
Validation of the backtesting process under the targeted review of internal models: practical recommendations for probability of default models
Need to know
- This paper complements the validation function. The purpose of this study is to provide practical guidance on validating the backtesting process.
- For the introductory validation of the backtesting process, the validation team should assess the data quality standards, data directory and databases used for creating the backtesting dataset.
- For the assessment of the backtesting frequency, the validation team should confirm the appropriateness of the size of the observation window in order to ensure that the poor performance of the model is not masked.
- For the validation of the calibration backtest, the validation team should assess the homogeneity of the rating groups, differences between the PD estimates and realised observations and the appropriateness of the hypothesis underpinning the analysed statistical tests.
- For the validation of the discriminatory power, the validation team should at least interpret the curves with the associated statistics and assess the number of defaults.
- For the validation of the stability backtest, the validation team should assess the power of the statistical test based on its assumptions and justify any PD’s deviations using macroeconomic factors.
Abstract
This paper provides practical recommendations for the validation of the backtesting process under the targeted review of internal models (TRIM). It advises on the introductory steps for validating the backtesting process and reviews the available statistical tests for calibration, discrimination and stability backtesting. The TRIM regulatory exercise is an international supervisory initiative that inspects the internal models and related internal risk and governance policies of eurozone banks that are permitted to use the advanced internal risk-based (AIRB) approach. Under the TRIM guidelines, the designated banks should have specific policies and internal guidelines for the validation of the backtesting process. Further, the affected banks are required to validate the entire backtesting process. Addressing these needs, this paper serves as a basis for producing such policies and utilizing appropriate statistical tools for validating the backtesting process. The paper focusses on probability of default models. To date, no academic study has discussed the validation of the backtesting process with reference to the TRIM rules.
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@risk.net
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@risk.net