Abstract:Credit scoring is an effective tool for banks to properly guide decision profitably on granting loans. Ensemble methods, which according to their structures can be divided into parallel and sequential ensembles, have been recently developed in the credit scoring domain. These methods have proven their superiority in discriminating borrowers accurately. However, among the ensemble models, little consideration has been provided to the following: (1) highlighting the hyper-parameter tuning of base learner despite being critical to well-performed ensemble models; (2) building sequential models (i.e., boosting, as most have focused on developing the same or different algorithms in parallel); and (3) focusing on the comprehensibility of models. This paper aims to propose a sequential ensemble credit scoring model based on a variant of gradient boosting machine (i.e., extreme gradient boosting (XGBoost)). The model mainly comprises three steps. First, data pre-processing is employed to scale the data and handle missing values. Second, a model-based feature selection system based on the relative feature importance scores is utilized to remove redundant variables. Third, the hyper-parameters of XGBoost are adaptively tuned with Bayesian hyper-parameter optimization and used to train the model with selected feature subset. Several hyper-parameter optimization methods and baseline classifiers are considered as reference points in the experiment. Results demonstrate that Bayesian hyper-parameter optimization performs better than random search, grid search, and manual search. Moreover, the proposed model outperforms baseline models on average over four evaluation measures: accuracy, error rate, the area under the curve (AUC) H measure (AUC-H measure), and Brier score. The proposed model also provides feature importance scores and decision chart, which enhance the interpretability of credit scoring model.

A Novel Method for Credit Scoring Based on Feature Transformation and Ensemble Model

A novel multi-stage ensemble model with enhanced outlier adaptation for credit scoring

A novel hybrid credit scoring model based on ensemble feature selection and multilayer ensemble classification

A Novel Multi-Stage Ensemble Model With a Hybrid Genetic Algorithm for Credit Scoring on Imbalanced Data

Enhanced Credit Score Prediction Using Ensemble Deep Learning Model

A New Hybrid Credit Scoring Ensemble Model with Feature Enhancement and Soft Voting Weight Optimization.

A novel ensemble model of multi-class credit assessment based on multi-source fusion theory

A multi-level classification based ensemble and feature extractor for credit risk assessment

Empirical Evaluation of Ensemble Learning for Credit Scoring

AttentionFM: Incorporating Attention Mechanism and Factorization Machine for Credit Scoring

Two Credit Scoring Models Based on Dual Strategy Ensemble Trees.

An Integrated Machine Learning and Deep Learning Framework for Credit Card Approval Prediction

Credit Scoring Models Using Ensemble Learning and Classification Approaches: A Comprehensive Survey

Credit Scoring Using Ensemble Classification Based on Variable Weighting Clustering

Feature Enhanced Ensemble Modeling with Voting Optimization for Credit Risk Assessment

A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring

Novel hybrid ensemble credit scoring model with stacking-based noise detection and weight assignment

Ensemble Methodology:Innovations in Credit Default Prediction Using LightGBM, XGBoost, and LocalEnsemble

Empirical Analysis of Ensemble Learning for Imbalanced Credit Scoring Datasets: A Systematic Review

A two-stage hybrid credit risk prediction model based on XGBoost and graph-based deep neural network

A ResNet-LSTM Based Credit Scoring Approach for Imbalanced Data