Abstract:Personal credit scoring is a challenging issue. In recent years, research has shown that machine learning has satisfactory performance in credit scoring. Because of the advantages of feature combination and feature selection, decision trees can match credit data which have high dimension and a complex correlation. Decision trees tend to overfitting yet. eXtreme Gradient Boosting is an advanced gradient enhanced tree that overcomes its shortcomings by integrating tree models. The structure of the model is determined by hyperparameters, which is aimed at the time-consuming and laborious problem of manual tuning, and the optimization method is employed for tuning. As particle swarm optimization describes the particle state and its motion law as continuous real numbers, the hyperparameter applicable to eXtreme Gradient Boosting can find its optimal value in the continuous search space. However, classical particle swarm optimization tends to fall into local optima. To solve this problem, this paper proposes an eXtreme Gradient Boosting credit scoring model that is based on adaptive particle swarm optimization. The swarm split, which is based on the clustering idea and two kinds of learning strategies, is employed to guide the particles to improve the diversity of the subswarms, in order to prevent the algorithm from falling into a local optimum. In the experiment, several traditional machine learning algorithms and popular ensemble learning classifiers, as well as four hyperparameter optimization methods (grid search, random search, tree-structured Parzen estimator, and particle swarm optimization), are considered for comparison. Experiments were performed with four credit datasets and seven KEEL benchmark datasets over five popular evaluation measures: accuracy, error rate (type I error and type II error), Brier score, and F 1 score. Results demonstrate that the proposed model outperforms other models on average. Moreover, adaptive particle swarm optimization performs better than the other hyperparameter optimization strategies.

SVM with nearest point algorithm and self-adaptive parameter for evaluating credit risk

Credit Scoring by Feature-Weighted Support Vector Machines

Credit Risk Identification of Bank Client Basing on Supporting Vector Machines

A Novel Approach to Optimise Credit Risk Prediction with Enhanced SVM and and Hinge Loss

Non-negative Matrix Factorization Via Projected Gradient Method for Credit Risk Analysis

Identification of a standard AI based technique for credit risk analysis

Data Driven Credit Risk Management Process: a Machine Learning Approach

Robust cost-sensitive kernel method with Blinex loss and its applications in credit risk evaluation

Financial Risk Management using Machine Learning Method

XGBoost Optimized by Adaptive Particle Swarm Optimization for Credit Scoring

Prediction of personal default risks based on a sparrow search algorithm with support vector machine model

A novel dual-weighted fuzzy proximal support vector machine with application to credit risk analysis

Personal credit risk identification based on combined machine learning model

Enhancing credit risk prediction with hybrid deep learning and sand cat swarm feature selection

A Framework for Credit Risk Prediction Using the Optimized-FKSVR Machine Learning Classifier

A New Parameter Selection Method for Support Vector Machine Based on the Decision Value.

Optimal cost-sensitive credit scoring using a new hybrid performance metric

Feature Enhanced Ensemble Modeling with Voting Optimization for Credit Risk Assessment

Three local search-based methods for feature selection in credit scoring

Application of Machine Learning in Credit Risk Scorecard