Abstract:Subject. This article deals with the issues of validation of the consistency of rating-based model forecasts. Objectives. The article aims to provide developers and validators of rating-based models with a practical fundamental test for benchmarking study of the estimated default probability values obtained as a result of the application of models used in the rating system. Methods. For the study, I used the classical interval approach to testing of statistical hypotheses focused on the subject area of calibration of rating systems. Results. In addition to the generally accepted tests for the correspondence of the predicted probabilities of default of credit risk objects to the historically realized values, the article proposes a new statistical test that corrects the shortcomings of the generally accepted ones, focused on "diagnosing" the consistency of the implemented discrimination of objects by the rating model. Examples of recognizing the reasons for a negative test result and negative consequences for lending are given while maintaining the current settings of the rating model. In addition to the bias in the assessment of the total frequency of defaults in the loan portfolio, the proposed method makes it possible to objectively reveal the inadequacy of discrimination against borrowers with a calibrated rating model, diagnose the “disease” of the rating model. Conclusions and Relevance. The new practical benchmark test allows to reject the hypothesis about the consistency of assessing the probability of default by the rating model at a given level of confidence and available historical data. The test has the advantage of practical interpretability based on its results, it is possible to draw a conclusion about the direction of the model correction. The offered test can be used in the process of internal validation by the bank of its own rating models, which is required by the Bank of Russia for approaches based on internal ratings.

Method of indirect estimation of default probability dynamics for industry-target segments according to the data of Bank of Russia

A New Method of Measuring Default Probability with Complete Information in Credit Ratings

AI-system, correlation-regression model and VaR-model for prediction of overdue debt of commercial banks of the Russian Federation and analysis of financial risk

Benchmark test for calculated default probability values derived from the application of rating-based models

Distance to default as a measure of default risk

Endogenous Derivation and Forecast of Lifetime PDs

On the Modeling of Prepayments for Variable Rate Institutional Loans - Ascertaining the Inference of Bank Internal Default Probabilities on Subsequent Prepayments

Estimating Default Probability and Correlation using Stan

Inferred Rate of Default as a Credit Risk Indicator in the Bulgarian Bank System

Development of a system of financial risk indicators based on logistic regression and the CorporateMetrics methodology

Retail credit stress testing using a discrete hazard model with macroeconomic factors

Probability of Default modelling with Lévy-driven Ornstein-Uhlenbeck processes and applications in credit risk under the IFRS 9

Dependent default and recovery: MCMC study of downturn LGD credit risk model

Disentangling and assessing uncertainties in multiperiod corporate default risk predictions

Developing a model for predicting bankruptcy of construction industry enterprises

New Definition of Default—Recalibration of Credit Risk Models Using Bayesian Approach

Loss rate forecasting framework based on macroeconomic changes: Application to US credit card industry

Estimating Probabilities of Default for Low Default Portfolios

Predicting Credit Default Probabilities Using Bayesian Statistics and Monte Carlo Simulations

CREDIT RISK ASSESSMENT MODELS AT THE BEHAVIOR-SCORING STAGE

Phase transition in the Bayesian estimation of the default portfolio