Abstract:Credit scoring is an effective tool for banks to properly guide decision profitably on granting loans. Ensemble methods, which according to their structures can be divided into parallel and sequential ensembles, have been recently developed in the credit scoring domain. These methods have proven their superiority in discriminating borrowers accurately. However, among the ensemble models, little consideration has been provided to the following: (1) highlighting the hyper-parameter tuning of base learner despite being critical to well-performed ensemble models; (2) building sequential models (i.e., boosting, as most have focused on developing the same or different algorithms in parallel); and (3) focusing on the comprehensibility of models. This paper aims to propose a sequential ensemble credit scoring model based on a variant of gradient boosting machine (i.e., extreme gradient boosting (XGBoost)). The model mainly comprises three steps. First, data pre-processing is employed to scale the data and handle missing values. Second, a model-based feature selection system based on the relative feature importance scores is utilized to remove redundant variables. Third, the hyper-parameters of XGBoost are adaptively tuned with Bayesian hyper-parameter optimization and used to train the model with selected feature subset. Several hyper-parameter optimization methods and baseline classifiers are considered as reference points in the experiment. Results demonstrate that Bayesian hyper-parameter optimization performs better than random search, grid search, and manual search. Moreover, the proposed model outperforms baseline models on average over four evaluation measures: accuracy, error rate, the area under the curve (AUC) H measure (AUC-H measure), and Brier score. The proposed model also provides feature importance scores and decision chart, which enhance the interpretability of credit scoring model.

A novel multi-stage ensemble model with enhanced outlier adaptation for credit scoring

A Novel Multi-Stage Ensemble Model With a Hybrid Genetic Algorithm for Credit Scoring on Imbalanced Data

A New Hybrid Credit Scoring Ensemble Model with Feature Enhancement and Soft Voting Weight Optimization.

Novel hybrid ensemble credit scoring model with stacking-based noise detection and weight assignment

Feature Enhanced Ensemble Modeling with Voting Optimization for Credit Risk Assessment

Empirical Evaluation of Ensemble Learning for Credit Scoring

A novel hybrid credit scoring model based on ensemble feature selection and multilayer ensemble classification

A novel ensemble model of multi-class credit assessment based on multi-source fusion theory

An Integrated Machine Learning and Deep Learning Framework for Credit Card Approval Prediction

Ensemble Methodology:Innovations in Credit Default Prediction Using LightGBM, XGBoost, and LocalEnsemble

Enhanced Credit Score Prediction Using Ensemble Deep Learning Model

A comparative study on machine learning models combining with outlier detection and balanced sampling methods for credit scoring

A novel multi-stage ensemble model with fuzzy clustering and optimized classifier composition for corporate bankruptcy prediction

How Do Machine Learning and Non-Traditional Data Affect Credit Scoring? New Evidence from a Chinese Fintech Firm

Empirical Analysis of Ensemble Learning for Imbalanced Credit Scoring Datasets: A Systematic Review

Multiple optimized ensemble learning for high-dimensional imbalanced credit scoring datasets

A machine learning-based credit risk prediction engine system using a stacked classifier and a filter-based feature selection method

A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring

A multi-level classification based ensemble and feature extractor for credit risk assessment

Credit Scoring Using Ensemble Classification Based on Variable Weighting Clustering

A two-stage hybrid credit risk prediction model based on XGBoost and graph-based deep neural network