Abstract:In the domain of credit risk assessment lenders may have limited or no data on the historical lending outcomes of credit applicants. Typically this disproportionately affects Micro, Small, and Medium Enterprises (MSMEs), for which credit may be restricted or too costly, due to the difficulty of predicting the Probability of Default (PD). However, if data from other related credit risk domains is available Transfer Learning may be applied to successfully train models, e.g., from the credit card lending and debt consolidation (CD) domains to predict in the small business lending domain. In this article, we report successful results from an approach using transfer learning to predict the probability of default based on the novel concept of Progressive Shift Contribution (PSC) from source to target domain. Toward real-world application by lenders of this approach, we further address two key questions. The first is to explain transfer learning models, and the second is to adjust features when the source and target domains differ. To address the first question, we apply Shapley values to investigate how and why transfer learning improves model accuracy, and also propose and test a domain adaptation approach to address the second. These results show that adaptation improves model accuracy in addition to the improvement from transfer learning. We extend this by proposing and testing a combined strategy of feature selection and adaptation to convert values of source domain features to better approximate values of target domain features. Our approach includes a strategy to choose features for adaptation and an algorithm to adapt the values of these features. In this setting, transfer learning appears to improve model accuracy by increasing the contribution of less predictive features. Although the percentage improvements are small, such improvements in real world lending could be of significant economic importance.

Leveraging Convolutional Neural Network-Transformer Synergy for Predictive Modeling in Risk-Based Applications

A transformer-based model for default prediction in mid-cap corporate markets

A two-stage hybrid credit risk prediction model based on XGBoost and graph-based deep neural network

A deep learning model-based approach to financial risk assessment and prediction

A Credit Risk Predicting Hybrid Model Based on Deep Learning Technology

Hybrid Model for Credit Risk Prediction: an Application of Neural Network Approaches.

An Integrated Machine Learning and Deep Learning Framework for Credit Card Approval Prediction

Transfer Learning-Based Default Prediction Model for Consumer Credit in China

Financial risk assessment to improve the accuracy of financial prediction in the internet financial industry using data analytics models

Enhancing Risk Assessment in Transformers with Loss-at-Risk Functions

Deep learning model-driven financial risk prediction and analysis

Personal credit default prediction fusion framework based on self-attention and cross-network algorithms

Advanced Risk Prediction and Stability Assessment of Banks Using Time Series Transformer Models

Credit Risk Evaluation Model with Textual Features from Loan Descriptions for P2P Lending

Credit Card Fraud Detection Using Advanced Transformer Model

Combined Model of Empirical Study for Credit Risk Management

Credit Risk Modeling Using Transfer Learning and Domain Adaptation

Research on Financial Risk Intelligent Monitoring and Early Warning Model Based on LSTM, Transformer, and Deep Learning

A Novel Hybrid Ensemble Model Based on Tree-Based Method and Deep Learning Method for Default Prediction.

Research on Default Prediction Model of Corporate Credit Risk Based on Big Data Analysis Algorithm

DeRisk: An Effective Deep Learning Framework for Credit Risk Prediction over Real-World Financial Data