Abstract:In credit evaluation, feature selection and grouping effect analysis are used to identify the most relevant credit risk features. Most feature selection and grouping effect analysis are implemented via regularizing linear models. Nevertheless, substantial evidence shows that credit data are linearly inseparable due to heterogeneous credit customers and various risk sources. Although many nonlinear models have been proposed in the last two decades, the majority of them required recombination of the original features, which made it difficult to interpret the results of the models. To cope with this dilemma, we propose a diagonal distance metric learning model that improves distance metrics by rescaling the features. Meanwhile, feature selection and grouping effect analysis are realized by adding regularizations to the model. The main merit of the proposed model is that it avoids the limitation of the linear models by not pursuing linear separability, yet guaranteeing the interpretability. We also prove and explain why feature selection and grouping effect can be achieved and decompose the optimization problem into parallel linear programming problems, plus a small quadratic consensus-reaching problem, such that the optimization can be efficiently solved. Experiments using a real credit data set of 96,000 instances show that the proposed model improves the area under the receiver operating characteristic curve (AUC) of the distance-based classifier k-nearest neighbors by 14% in two-class credit evaluation and surpasses linear models in terms of accuracy, true positive rate, and AUC. The proposed regularized diagonal distance metric learning approach also has the potential to be applied to other fields where data are linearly inseparable. History: Accepted by Ram Ramesh, Area Editor for Data Science and Machine Learning. Funding: Financial support from the National Social Science Fund of China [Grant 23BTJ040] and the National Natural Science Foundation of China [Grants 72471047 and 71910107002] is gratefully acknowledged. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2023.0322 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2023.0322 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .

Combining Feature Selection and Classification Using LASSO-Based MCO Classifier for Credit Risk Evaluation

Feature Selection and Grouping Effect Analysis for Credit Evaluation via Regularized Diagonal Distance Metric Learning

A multi-level classification based ensemble and feature extractor for credit risk assessment

Combining Multiple Classifiers Based on Dempster-Shafer Theory for Personal Credit Scoring

Enhancing credit risk prediction with hybrid deep learning and sand cat swarm feature selection

Feature Enhanced Ensemble Modeling with Voting Optimization for Credit Risk Assessment

Multi-classification assessment of bank personal credit risk based on multi-source information fusion

Multi-classification assessment of personal credit risk based on stacking integration

A novel multi-stage ensemble model with enhanced outlier adaptation for credit scoring

Multiple optimized ensemble learning for high-dimensional imbalanced credit scoring datasets

Study On Pso-Cfs Feature Selection Algorithm For Credit Scoring

An empirical study of classification algorithm evaluation for financial risk prediction

A novel hybrid credit scoring model based on ensemble feature selection and multilayer ensemble classification

An attention‐based Logistic‐CNN‐BiLSTM hybrid neural network for credit risk prediction of listed real estate enterprises

An Integrated Machine Learning and Deep Learning Framework for Credit Card Approval Prediction

Cost-sensitive Classifiers in Credit Rating: A Comparative Study on P2P Lending

Default discrimination of credit card: Feature combination selection based on improved FDAF-score

A New Hybrid Credit Scoring Ensemble Model with Feature Enhancement and Soft Voting Weight Optimization.

Application of Data Mining Combined with Fuzzy Multicriteria Decision-Making in Credit Risk Assessment from Legal Service Companies

A robust framework for enhancing cardiovascular disease risk prediction using an optimized category boosting model

OptimizingEnsemble Learning to Reduce Misclassification Costs in Credit Risk Scorecards