Abstract:Personal credit scoring is a challenging issue. In recent years, research has shown that machine learning has satisfactory performance in credit scoring. Because of the advantages of feature combination and feature selection, decision trees can match credit data which have high dimension and a complex correlation. Decision trees tend to overfitting yet. eXtreme Gradient Boosting is an advanced gradient enhanced tree that overcomes its shortcomings by integrating tree models. The structure of the model is determined by hyperparameters, which is aimed at the time-consuming and laborious problem of manual tuning, and the optimization method is employed for tuning. As particle swarm optimization describes the particle state and its motion law as continuous real numbers, the hyperparameter applicable to eXtreme Gradient Boosting can find its optimal value in the continuous search space. However, classical particle swarm optimization tends to fall into local optima. To solve this problem, this paper proposes an eXtreme Gradient Boosting credit scoring model that is based on adaptive particle swarm optimization. The swarm split, which is based on the clustering idea and two kinds of learning strategies, is employed to guide the particles to improve the diversity of the subswarms, in order to prevent the algorithm from falling into a local optimum. In the experiment, several traditional machine learning algorithms and popular ensemble learning classifiers, as well as four hyperparameter optimization methods (grid search, random search, tree-structured Parzen estimator, and particle swarm optimization), are considered for comparison. Experiments were performed with four credit datasets and seven KEEL benchmark datasets over five popular evaluation measures: accuracy, error rate (type I error and type II error), Brier score, and F 1 score. Results demonstrate that the proposed model outperforms other models on average. Moreover, adaptive particle swarm optimization performs better than the other hyperparameter optimization strategies.

Iterative XGBoost Algorithm and Application on Modeling the Cognitive Laws of Chinese Characters Based on Psychological Cognitive Feature Extraction

Predicting Chinese stock market using XGBoost multi-objective optimization with optimal weighting

Research on the Classification Calculation Based on the Local Features of Hard-Pen Chinese Characters

Modeling and Predicting Learning Behavior in MOOCs

Characterizing Students' Learning Behaviors Using Unsupervised Learning Methods

Modeling the relationships among teacher instruction, learner belief, and learning strategies in Chinese character learning by alphabetic learners

Student Online Learning Behavior Characteristics Based on Multidimensional Cognitive Model

The Exploration of Modelling for The Student Achievement Predictor

An Interpretable Artificial Intelligence Model of Chinese Medicine Treatment Based on XGBoost Algorithm.

Factors influencing secondary school students’ reading literacy: An analysis based on XGBoost and SHAP methods

Analyse Chinese Teaching Project-Based Learning Design Application Optimization Using Keras Model

Predicting Learning Behavior Using Log Data in Blended Teaching

Machine Learning-Based Research on the Adaptability of Adolescents to Online Education

Harnessing XGBoost for Robust Biomarker Selection of Obsessive-Compulsive Disorder (OCD) from Adolescent Brain Cognitive Development (ABCD) data

Hierarchical Regression for Modeling the Effect of Learning Behavior on Blended Academic Assessment for College English

Multimodal Learning Engagement Assessment System: An Innovative Approach to Optimizing Learning Engagement

Effectiveness Analysis and Optimization Path of AI Tutoring Models in Foreign Language Learning Applications

Improving Chinese Character Representation with Formation Graph Attention Network

Group, Contrast and Recognize: A Self-supervised Method for Chinese Character Recognition.

An Approach of Optimizing Learner Model for Personalized Distance Learning/Training

XGBoost Optimized by Adaptive Particle Swarm Optimization for Credit Scoring