Abstract:Predicting credit default risk is important to financial institutions, as accurately predicting the likelihood of a borrower defaulting on their loans will help to reduce financial losses, thereby maintaining profitability and stability. Although machine learning models have been used in assessing large applications with complex attributes for these predictions, there is still a need to identify the most effective techniques for the model development process, including the technique to address the issue of data imbalance. In this research, we conducted a comparative analysis of random forest, decision tree, SVMs (Support Vector Machines), XGBoost (Extreme Gradient Boosting), ADABoost (Adaptive Boosting) and the multi-layered perceptron, to predict credit defaults using loan data from LendingClub. Additionally, XGBoost was used as a framework for testing and evaluating various techniques. Moreover, we applied this XGBoost framework to handle the issue of class imbalance observed, by testing various resampling methods such as Random Over-Sampling (ROS), the Synthetic Minority Over-Sampling Technique (SMOTE), Adaptive Synthetic Sampling (ADASYN), Random Under-Sampling (RUS), and hybrid approaches like the SMOTE with Tomek Links and the SMOTE with Edited Nearest Neighbours (SMOTE + ENNs). The results showed that balanced datasets significantly outperformed the imbalanced dataset, with the SMOTE + ENNs delivering the best overall performance, achieving an accuracy of 90.49%, a precision of 94.61% and a recall of 92.02%. Furthermore, ensemble methods such as voting and stacking were employed to enhance performance further. Our proposed model achieved an accuracy of 93.7%, a precision of 95.6% and a recall of 95.5%, which shows the potential of ensemble methods in improving credit default predictions and can provide lending platforms with the tool to reduce default rates and financial losses. In conclusion, the findings from this study have broader implications for financial institutions, offering a robust approach to risk assessment beyond the LendingClub dataset.

A novel dynamic ensemble selection classifier for an imbalanced data set: An application for credit risk assessment

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

An ensemble imbalanced classification method based on model dynamic selection driven by data partition hybrid sampling

Classification of Imbalanced Credit scoring data sets Based on Ensemble Method with the Weighted-Hybrid-Sampling

META-DES.H: a dynamic ensemble selection technique using meta-learning and a dynamic weighting approach

Resampling ensemble model based on data distribution for imbalanced credit risk evaluation in P2P lending

Experimental Study and Comparison of Imbalance Ensemble Classifiers with Dynamic Selection Strategy

Adaptive ensemble of classifiers with regularization for imbalanced data classification

A Novel Multi-Stage Ensemble Model With a Hybrid Genetic Algorithm for Credit Scoring on Imbalanced Data

A novel hybrid credit scoring model based on ensemble feature selection and multilayer ensemble classification

A DBN-based resampling SVM ensemble learning paradigm for credit classification with imbalanced data

Ensemble-Based Machine Learning Algorithm for Loan Default Risk Prediction

A DEEP analysis of the META-DES framework for dynamic selection of ensemble of classifiers

A multi-level classification based ensemble and feature extractor for credit risk assessment

Resampling Techniques Study on Class Imbalance Problem in Credit Risk Prediction

Application of Big Data Unbalanced Classification Algorithm in Credit Risk Analysis of Insurance Companies

Feature Enhanced Ensemble Modeling with Voting Optimization for Credit Risk Assessment

Multiple optimized ensemble learning for high-dimensional imbalanced credit scoring datasets

K-Nearest Oracles Borderline Dynamic Classifier Ensemble Selection

Enhancing Data Quality through Self-learning on Imbalanced Financial Risk Data

A Hybrid Predictive Framework for Evaluating P2P Credit Risks