Abstract:Predicting credit default risk is important to financial institutions, as accurately predicting the likelihood of a borrower defaulting on their loans will help to reduce financial losses, thereby maintaining profitability and stability. Although machine learning models have been used in assessing large applications with complex attributes for these predictions, there is still a need to identify the most effective techniques for the model development process, including the technique to address the issue of data imbalance. In this research, we conducted a comparative analysis of random forest, decision tree, SVMs (Support Vector Machines), XGBoost (Extreme Gradient Boosting), ADABoost (Adaptive Boosting) and the multi-layered perceptron, to predict credit defaults using loan data from LendingClub. Additionally, XGBoost was used as a framework for testing and evaluating various techniques. Moreover, we applied this XGBoost framework to handle the issue of class imbalance observed, by testing various resampling methods such as Random Over-Sampling (ROS), the Synthetic Minority Over-Sampling Technique (SMOTE), Adaptive Synthetic Sampling (ADASYN), Random Under-Sampling (RUS), and hybrid approaches like the SMOTE with Tomek Links and the SMOTE with Edited Nearest Neighbours (SMOTE + ENNs). The results showed that balanced datasets significantly outperformed the imbalanced dataset, with the SMOTE + ENNs delivering the best overall performance, achieving an accuracy of 90.49%, a precision of 94.61% and a recall of 92.02%. Furthermore, ensemble methods such as voting and stacking were employed to enhance performance further. Our proposed model achieved an accuracy of 93.7%, a precision of 95.6% and a recall of 95.5%, which shows the potential of ensemble methods in improving credit default predictions and can provide lending platforms with the tool to reduce default rates and financial losses. In conclusion, the findings from this study have broader implications for financial institutions, offering a robust approach to risk assessment beyond the LendingClub dataset.

Machine learning techniques in joint default assessment

How Do Machine Learning and Non-Traditional Data Affect Credit Scoring? New Evidence from a Chinese Fintech Firm

Ensemble Learning or Deep Learning? Application to Default Risk Analysis

Checking account activity and credit default risk of enterprises: An application of statistical learning methods

Modeling Default Risk with Support Vector Machines

A Spatio-Temporal Machine Learning Model for Mortgage Credit Risk: Default Probabilities and Loan Portfolios

Applying Machine Learning Methods for Credit Card Payment Default Prediction With Cost Savings

Firms Default Prediction with Machine Learning

Application of Machine Learning in Loan Default Prediction

Ensemble-Based Machine Learning Algorithm for Loan Default Risk Prediction

Calibration of Machine Learning Classifiers for Probability of Default Modelling

Prediction and Analysis of Financial Default Loan Behavior Based on Machine Learning Model

An implementation of ensemble methods, logistic regression, and neural network for default prediction in Peer-to-Peer lending

Measuring the model risk-adjusted performance of machine learning algorithms in credit default prediction

Modelling small and medium enterprise loan defaults as rare events: the generalized extreme value regression model

Probability of default for lifetime credit loss for IFRS 9 using machine learning competing risks survival analysis models

A novel two-stage hybrid default prediction model with k-means clustering and support vector domain description

Machine learning loss given default for corporate debt

The Impact of Feature Selection and Transformation on Machine Learning Methods in Determining the Credit Scoring

A machine learning workflow to address credit default prediction