Abstract:Personal credit scoring is a challenging issue. In recent years, research has shown that machine learning has satisfactory performance in credit scoring. Because of the advantages of feature combination and feature selection, decision trees can match credit data which have high dimension and a complex correlation. Decision trees tend to overfitting yet. eXtreme Gradient Boosting is an advanced gradient enhanced tree that overcomes its shortcomings by integrating tree models. The structure of the model is determined by hyperparameters, which is aimed at the time-consuming and laborious problem of manual tuning, and the optimization method is employed for tuning. As particle swarm optimization describes the particle state and its motion law as continuous real numbers, the hyperparameter applicable to eXtreme Gradient Boosting can find its optimal value in the continuous search space. However, classical particle swarm optimization tends to fall into local optima. To solve this problem, this paper proposes an eXtreme Gradient Boosting credit scoring model that is based on adaptive particle swarm optimization. The swarm split, which is based on the clustering idea and two kinds of learning strategies, is employed to guide the particles to improve the diversity of the subswarms, in order to prevent the algorithm from falling into a local optimum. In the experiment, several traditional machine learning algorithms and popular ensemble learning classifiers, as well as four hyperparameter optimization methods (grid search, random search, tree-structured Parzen estimator, and particle swarm optimization), are considered for comparison. Experiments were performed with four credit datasets and seven KEEL benchmark datasets over five popular evaluation measures: accuracy, error rate (type I error and type II error), Brier score, and F 1 score. Results demonstrate that the proposed model outperforms other models on average. Moreover, adaptive particle swarm optimization performs better than the other hyperparameter optimization strategies.

Credit Risk Assessment based on Gradient Boosting Decision Tree

Gradient Boosting Survival Tree with Applications in Credit Scoring

XGBoost Optimized by Adaptive Particle Swarm Optimization for Credit Scoring

Multi-grained and multi-layered gradient boosting decision tree for credit scoring

A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring

Assessment of Deep Neural Network and Gradient Boosting Machines for Credit Risk Prediction Accuracy

Credit risk analysis using boosting methods

An improved gradient boosting tree algorithm for financial risk management

Deep Learning vs. Gradient Boosting: Benchmarking state-of-the-art machine learning algorithms for credit scoring

A two-stage hybrid credit risk prediction model based on XGBoost and graph-based deep neural network

A novel SSA-CatBoost machine learning model for credit rating

Research on credit risk assessment optimization based on machine learning

A Hybrid Model for Credit Risk Assessment: Empirical Validation by Real-World Credit Data

A deep learning model-based approach to financial risk assessment and prediction

Predicting of Credit Default by SVM and Decision Tree Model Based on Credit Card Data

Improved ML-Based Technique for Credit Card Scoring in Internet Financial Risk Control

Two Credit Scoring Models Based on Dual Strategy Ensemble Trees.

Cost-sensitive boosted tree for loan evaluation in peer-to-peer lending

Non-negative Matrix Factorization Via Projected Gradient Method for Credit Risk Analysis

A credit risk assessment on borrowers classification using optimized decision tree and KNN with bayesian optimization

A machine learning-based credit risk prediction engine system using a stacked classifier and a filter-based feature selection method