Abstract:In credit evaluation, feature selection and grouping effect analysis are used to identify the most relevant credit risk features. Most feature selection and grouping effect analysis are implemented via regularizing linear models. Nevertheless, substantial evidence shows that credit data are linearly inseparable due to heterogeneous credit customers and various risk sources. Although many nonlinear models have been proposed in the last two decades, the majority of them required recombination of the original features, which made it difficult to interpret the results of the models. To cope with this dilemma, we propose a diagonal distance metric learning model that improves distance metrics by rescaling the features. Meanwhile, feature selection and grouping effect analysis are realized by adding regularizations to the model. The main merit of the proposed model is that it avoids the limitation of the linear models by not pursuing linear separability, yet guaranteeing the interpretability. We also prove and explain why feature selection and grouping effect can be achieved and decompose the optimization problem into parallel linear programming problems, plus a small quadratic consensus-reaching problem, such that the optimization can be efficiently solved. Experiments using a real credit data set of 96,000 instances show that the proposed model improves the area under the receiver operating characteristic curve (AUC) of the distance-based classifier k-nearest neighbors by 14% in two-class credit evaluation and surpasses linear models in terms of accuracy, true positive rate, and AUC. The proposed regularized diagonal distance metric learning approach also has the potential to be applied to other fields where data are linearly inseparable. History: Accepted by Ram Ramesh, Area Editor for Data Science and Machine Learning. Funding: Financial support from the National Social Science Fund of China [Grant 23BTJ040] and the National Natural Science Foundation of China [Grants 72471047 and 71910107002] is gratefully acknowledged. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2023.0322 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2023.0322 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .

Orthogonal Support Vector Machine for Credit Scoring

Credit Scoring Model Hybridizing Artificial Intelligence with Logistic Regression.

Classification and Dimension Reduction in Bank Credit Scoring System

Application of Support Vector Machines Method in Credit Scoring

A Support Vector Machine Based Method for Credit Risk Assessment

A MODIFIED LEAST SQUARES SUPPORT VECTOR MACHINE CLASSIFIER WITH APPLICATION TO CREDIT RISK ANALYSIS

A Modified Support Vector Machine Model for Credit Scoring

Svm-Based Credit Rating and Feature Selection

Credit risk evaluation with least square support vector machine

A Two-Phase Model Based on SVM and Conjoint Analysis for Credit Scoring

Credit scoring using the hybrid support vector machine technique

Non-negative Matrix Factorization Via Projected Gradient Method for Credit Risk Analysis

Credit scoring models and credit-risk evaluation based on support vector machines

Credit risk evaluation using a weighted least squares SVM classifier with design of experiment for parameter selection

Credit Scoring by Feature-Weighted Support Vector Machines

An Improved Support Vector Machine and Its Application in P2P Lending Personal Credit Scoring

The Impact of Feature Selection and Transformation on Machine Learning Methods in Determining the Credit Scoring

Credit Scoring Using Logistic Regression Method

Mining the customer credit using hybrid support vector machine technique

Personal Credit Scoring Based on Hybrid Support Vector Machines with Cluster Analysis

Feature Selection and Grouping Effect Analysis for Credit Evaluation via Regularized Diagonal Distance Metric Learning