Abstract:Decision tree (DT) is one of the most popular classification algorithms in data mining and machine learning. However, the performance of DT based credit scoring model is often relatively poorer than other techniques. This is mainly due to two reasons: DT is easily affected by (1) the noise data and (2) the redundant attributes of data under the circumstance of credit scoring. In this study, we propose two dual strategy ensemble trees: RS-Bagging DT and Bagging-RS DT, which are based on two ensemble strategies: bagging and random subspace, to reduce the influences of the noise data and the redundant attributes of data and to get the relatively higher classification accuracy. Two real world credit datasets are selected to demonstrate the effectiveness and feasibility of proposed methods. Experimental results reveal that single DT gets the lowest average accuracy among five single classifiers, i.e., Logistic Regression Analysis (LRA), Linear Discriminant Analysis (LDA), Multi-layer Perceptron (MLP) and Radial Basis Function Network (RBFN). Moreover, RS-Bagging DT and Bagging-RS DT get the better results than five single classifiers and four popular ensemble classifiers, i.e., Bagging DT, Random Subspace DT, Random Forest and Rotation Forest. The results show that RS-Bagging DT and Bagging-RS DT can be used as alternative techniques for credit scoring.

A Two-Phase Model Based on SVM and Conjoint Analysis for Credit Scoring

Least squares support vector machines ensemble models for credit scoring

A Combined Credit Scoring Model Based On Posterior Probability Svm And Logistic Regression For Residential Loans

Credit risk evaluation with least square support vector machine

A Support Vector Machine Based Method for Credit Risk Assessment

A hybrid credit scoring model based on clustering and support vector machines

Personal Credit Scoring Based on Hybrid Support Vector Machines with Cluster Analysis

Credit Risk Assessment with Least Squares Fuzzy Support Vector Machines

Credit Scoring by Feature-Weighted Support Vector Machines

Application Research of Consumer Credit Score Model Based on Svm and Dea

The Model of Personal Credit Risk Assessment On Support Vector Machine

Credit Scoring Based on Eigencredits and SVDD.

Credit Scoring Model Hybridizing Artificial Intelligence with Logistic Regression.

Credit risk evaluation using a weighted least squares SVM classifier with design of experiment for parameter selection

A Least Squares Bilateral-Weighted Fuzzy SVM Method to Evaluate Credit Risk

Application of Support Vector Machines Method in Credit Scoring

Personal Credit Scoring Based on PCA and SVM

A KERNEL PRINCIPAL COMPONENT ANALYSIS BASED LEAST SQUARES FUZZY SUPPORT VECTOR MACHINE METHODOLOGY WITH VARIABLE PENALTY FACTORS FOR CREDIT CLASSIFICATION

A Modified Support Vector Machine Model for Credit Scoring

Two Credit Scoring Models Based on Dual Strategy Ensemble Trees.

A New Ensemble Model Based Support Vector Machine for Credit Assessing