Abstract:Credit scoring is an effective tool for banks to properly guide decision profitably on granting loans. Ensemble methods, which according to their structures can be divided into parallel and sequential ensembles, have been recently developed in the credit scoring domain. These methods have proven their superiority in discriminating borrowers accurately. However, among the ensemble models, little consideration has been provided to the following: (1) highlighting the hyper-parameter tuning of base learner despite being critical to well-performed ensemble models; (2) building sequential models (i.e., boosting, as most have focused on developing the same or different algorithms in parallel); and (3) focusing on the comprehensibility of models. This paper aims to propose a sequential ensemble credit scoring model based on a variant of gradient boosting machine (i.e., extreme gradient boosting (XGBoost)). The model mainly comprises three steps. First, data pre-processing is employed to scale the data and handle missing values. Second, a model-based feature selection system based on the relative feature importance scores is utilized to remove redundant variables. Third, the hyper-parameters of XGBoost are adaptively tuned with Bayesian hyper-parameter optimization and used to train the model with selected feature subset. Several hyper-parameter optimization methods and baseline classifiers are considered as reference points in the experiment. Results demonstrate that Bayesian hyper-parameter optimization performs better than random search, grid search, and manual search. Moreover, the proposed model outperforms baseline models on average over four evaluation measures: accuracy, error rate, the area under the curve (AUC) H measure (AUC-H measure), and Brier score. The proposed model also provides feature importance scores and decision chart, which enhance the interpretability of credit scoring model.

A comparative study on base classifiers in ensemble methods for credit scoring

A Comparative Assessment of Ensemble Learning for Credit Scoring

Empirical Evaluation of Ensemble Learning for Credit Scoring

Ensemble Classification Based on Supervised Clustering for Credit Scoring

Bayesian Ensemble Assessment for Credit Scoring

Credit Scoring Models Using Ensemble Learning and Classification Approaches: A Comprehensive Survey

A Novel Ensemble Classification Model Based on Neural Networks and a Classifier Optimisation Technique for Imbalanced Credit Risk Evaluation

A Heterogeneous Ensemble Credit Scoring Model Based on Adaptive Classifier Selection: an Application on Imbalanced Data

A Comparative Assessment of Credit Risk Model Based on Machine Learning ——a case study of bank loan data

Credit Scoring Using Ensemble Classification Based on Variable Weighting Clustering

Study Of Personal Credit Risk Assessment Based On Support Vector Machine Ensemble

Dynamic Ensemble Classification for Credit Scoring Using Soft Probability

Empirical Analysis of Ensemble Learning for Imbalanced Credit Scoring Datasets: A Systematic Review

Ensemble Algorithms With Diversity Measures For Credit Scoring

Evaluation metrics and dimensional reduction for binary classification algorithms: a case study on bankruptcy prediction

A novel multi-stage ensemble model with enhanced outlier adaptation for credit scoring

Features selection, data mining and finacial risk classification: a comparative study

Predicting credit default probabilities using machine learning techniques in the face of unequal class distributions

A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring

An empirical evaluation of the performance of binary classifiers in the prediction of credit ratings changes

A Comparison of Ensemble Methods in Financial Market Prediction.