A method of classifying imbalanced credit data based on the AC-CTGAN hybrid sampling algorithm

Tinggui Chen,Hailian Gu,Zhiyu Zang,Jianjun Yang,Bing Wang

DOI: https://doi.org/10.21314/jcr.2024.007

IF: 0.645

2024-11-27

The Journal of Operational Risk

Abstract:The authors put forward a novel method with which to identify risk in consumer credit data and demonstrate its enhanced generalization ability compared to commonly used methods.

business, finance

What problem does this paper attempt to address?

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

Yan Han,Mingxiang He,Qixian Lu

DOI: https://doi.org/10.1007/978-981-13-5841-8_64

2018-01-01

Abstract:In order to alleviate the impact of imbalanced data on support vector machine (SVM), an integrated hybrid sampling imbalanced data classification method is proposed. First, the imbalance rate of imbalanced data is reduced by the ADASYN-NCL (Adaptive Synthetic Sampling Technique—Domain Cleanup Rule Downsampling Method) hybrid sampling method. Then, the AdaBoost algorithm framework is used to give different weight adjustments to the misclassification of minority and majority classes, and selectively integrate several classifiers to obtain better classification. Finally, use the 10 sets of imbalanced data in the KEEL database as test objects, and F-value and G-mean are used as evaluation indicators to verify the performance of the classification algorithm. The experimental results show that the classification algorithm has certain advantages for the classification effect of imbalanced data sets.
Research on Default Classification of Unbalanced Credit Data Based on PixelCNN-WGAN

Yutong Sun,Yanting Ji,Xiangxing Tao

DOI: https://doi.org/10.3390/electronics13173419

IF: 2.9

2024-08-30

Electronics

Abstract:Personal credit assessment plays a crucial role in the financial system, which not only relates to the financial activities of individuals but also affects the overall credit system and economic health of society. However, the current problem of data imbalance affecting classification results in the field of personal credit assessment has not been fully solved. In order to solve this problem better, we propose a data-enhanced classification algorithm based on a Pixel Convolutional Neural Network (PixelCNN) and a Generative Adversarial Network (Wasserstein GAN, WGAN). Firstly, the historical data containing borrowers' borrowing information are transformed into grayscale maps; then, data enhancement of default images is performed using the improved PixelCNN-WGAN model; and finally, the expanded image dataset is inputted into the CNN, AlexNet, SqueezeNet, and MobileNetV2 for classification. The results on the real dataset LendingClub show that the data enhancement algorithm designed in this paper improves the accuracy of the four algorithms by 1.548–3.568% compared with the original dataset, which can effectively improve the classification effect of the credit data, and to a certain extent, it provides a new idea for the classification task in the field of personal credit assessment.

engineering, electrical & electronic,computer science, information systems,physics, applied
A ResNet-LSTM Based Credit Scoring Approach for Imbalanced Data

Anqin Zhang,Baicheng Peng,Jingjing Chen,Qingfu Liu,Shibo Jiang,Youmei Zhou

DOI: https://doi.org/10.1155/2022/9103437

2022-01-01

Abstract:Detecting potential defaults or bad debt with limited information has become a huge challenge. The main difficulties faced by the credit scoring are sample imbalance and poor classification performance. For this reason, we first proposed the auxiliary conditional tabular generative adversarial network (ACTGAN) to generate sufficient default transaction samples from the original data, then we designed a model based on ResNet-LSTM used for feature extraction, which includes two submodels of ResNet and LSTM to extract static local features and dynamic temporal features from the original data, respectively. After that, a spatiotemporal attention module is added to calculate the importance of the two submodel’s output in order to extract more critical information. Finally, we applied the focus loss function into the XGBoost classifier to improve the probability output of the credit default risk. We verified the designed credit scoring model in two real-world datasets. The experimental results showed that ACTGAN can effectively solve the problem of data imbalance. The ResNet-LSTM+XGBoost model for classification is better than other traditional algorithms in F1 value, AUC, and KS value, which proves the effectiveness and portability of this model in the field of credit scoring.
A Novel Multi-Stage Ensemble Model With a Hybrid Genetic Algorithm for Credit Scoring on Imbalanced Data

Yilun Jin,Wenyu Zhang,Xin Wu,Yanan Liu,Zeqian Hu

DOI: https://doi.org/10.1109/access.2021.3120086

IF: 3.9

2021-01-01

IEEE Access

Abstract:Credit scoring models are the cornerstone of the modern financial industry. After years of development, artificial intelligence and machine learning have led to the transformation of traditional credit scoring models based on statistics. In this study, a novel multi-stage ensemble model with a hybrid genetic algorithm is proposed to achieve accurate and stable credit prediction. To alleviate the adverse effects of imbalanced data in credit scoring models, the Instance Hardness Threshold method is extended using a majority voting strategy to deal with data imbalance. To eliminate redundant and irrelevant features in the dataset and select well-performing base classifiers, a new hybrid genetic algorithm is proposed to obtain the optimal feature subset and base classifier subset. To aggregate the predictive power of the base classifiers, a stacking approach is adopted to integrate the optimal base classifiers into the ensemble model. The proposed model is tested on three standard imbalanced credit scoring datasets, compared with similar state-of-the-art approaches, and evaluated using four well-known evaluation indicators. The experimental results prove the effectiveness of the proposed model and demonstrate its superiority.

computer science, information systems,telecommunications,engineering, electrical & electronic
CDGAT: a graph attention network method for credit card defaulters prediction

Jun Wu,XiongFei Zhao,Hang Yuan,Yain-Whar Si

DOI: https://doi.org/10.1007/s10489-022-03996-1

IF: 5.3

2022-09-08

Applied Intelligence

Abstract:Recognizing potential defaulters is a crucial problem for financial institutions. Therefore, many credit scoring methods have been proposed in the past to address this issue. However, these methods rarely consider the interaction among customers such as bank transfer and remittance. With rapid growth in the number of customers adopting online banking services, such interaction information plays a significant role in assessing their credit score. In this paper, we propose a novel scalable credit scoring approach called CDGAT (Graph attention network for credit card defaulters) for predicting potential credit card defaulters. In CDGAT, a customer's credit score is calculated based on transaction embedding and neighborhood embedding. To obtain the neighborhood embedding, CDGAT first utilizes the Amount-bias Sampling (AbS) strategy to extract a subgraph for each customer. Next, CDGAT directly aggregates neighbors' features according to their influence weights. The experimental results on the dataset from Industrial and Commercial Bank of China (Macau) Limited (ICBC (Macau)) show that CDGAT significantly outperforms the baseline methods. Furthermore, experimental results reveal that the proposed method is also superior to several state-of-the-art Graph Convolutional Neural Network models in terms of scalability and performance.

computer science, artificial intelligence
FinGAN: Generative Adversarial Network for Analytical Customer Relationship Management in Banking and Insurance

Prateek Kate,Vadlamani Ravi,Akhilesh Gangwar

DOI: https://doi.org/10.48550/arXiv.2201.11486

2022-01-27

Abstract:Churn prediction in credit cards, fraud detection in insurance, and loan default prediction are important analytical customer relationship management (ACRM) problems. Since frauds, churns and defaults happen less frequently, the datasets for these problems turn out to be naturally highly unbalanced. Consequently, all supervised machine learning classifiers tend to yield substantial false-positive rates when trained on such unbalanced datasets. We propose two ways of data balancing. In the first, we propose an oversampling method to generate synthetic samples of minority class using Generative Adversarial Network (GAN). We employ Vanilla GAN [1], Wasserstein GAN [2] and CTGAN [3] separately to oversample the minority class samples. In order to assess the efficacy of our proposed approach, we use a host of machine learning classifiers, including Random Forest, Decision Tree, support vector machine (SVM), and Logistic Regression on the data balanced by GANs. In the second method, we introduce a hybrid method to handle data imbalance. In this second way, we utilize the power of undersampling and over-sampling together by augmenting the synthetic minority class data oversampled by GAN with the undersampled majority class data obtained by one-class support vigor machine (OCSVM) [4]. We combine both over-sampled data generated by GAN and the data under-sampled by OCSVM [4] and pass the resultant data to classifiers. When we compared our results to those of Farquad et al. [5], Sundarkumar, Ravi, and Siddeshwar [6], our proposed methods outperform the previous results in terms of the area under the ROC curve (AUC) on all datasets.

Machine Learning,Computational Engineering, Finance, and Science,Neural and Evolutionary Computing
CTCN: a novel credit card fraud detection method based on Conditional Tabular Generative Adversarial Networks and Temporal Convolutional Network

Xiaoyan Zhao,Shaopeng Guan

DOI: https://doi.org/10.7717/peerj-cs.1634

2023-10-10

Abstract:Credit card fraud can lead to significant financial losses for both individuals and financial institutions. In this article, we propose a novel method called CTCN, which uses Conditional Tabular Generative Adversarial Networks (CTGAN) and temporal convolutional network (TCN) for credit card fraud detection. Our approach includes an oversampling algorithm that uses CTGAN to balance the dataset, and Neighborhood Cleaning Rule (NCL) to filter out majority class samples that overlap with the minority class. We generate synthetic minority class samples that conform to the original data distribution, resulting in a balanced dataset. We then employ TCN to analyze transaction sequences and capture long-term dependencies between data, revealing potential relationships between transaction sequences, thus achieving accurate credit card fraud detection. Experiments on three public datasets demonstrate that our proposed method outperforms current machine learning and deep learning methods, as measured by recall, F1-Score, and AUC-ROC.
A novel method for detecting credit card fraud problems

HaiChao Du,Li Lv,Hongliang Wang,An Guo

DOI: https://doi.org/10.1371/journal.pone.0294537

IF: 3.7

2024-03-06

PLoS ONE

Abstract:Credit card fraud is a significant problem that costs billions of dollars annually. Detecting fraudulent transactions is challenging due to the imbalance in class distribution, where the majority of transactions are legitimate. While pre-processing techniques such as oversampling of minority classes are commonly used to address this issue, they often generate unrealistic or overgeneralized samples. This paper proposes a method called autoencoder with probabilistic xgboost based on SMOTE and CGAN(AE-XGB-SMOTE-CGAN) for detecting credit card frauds.AE-XGB-SMOTE-CGAN is a novel method proposed for credit card fraud detection problems. The credit card fraud dataset comes from a real dataset anonymized by a bank and is highly imbalanced, with normal data far greater than fraud data. Autoencoder (AE) is used to extract relevant features from the dataset, enhancing the ability of feature representation learning, and are then fed into xgboost for classification according to the threshold. Additionally, in this study, we propose a novel approach that hybridizes Generative Adversarial Network (GAN) and Synthetic Minority Over-Sampling Technique (SMOTE) to tackle class imbalance problems. Our two-phase oversampling approach involves knowledge transfer and leverages the synergies of SMOTE and GAN. Specifically, GAN transforms the unrealistic or overgeneralized samples generated by SMOTE into realistic data distributions where there is not enough minority class data available for GAN to process effectively on its own. SMOTE is used to address class imbalance issues and CGAN is used to generate new, realistic data to supplement the original dataset. The AE-XGB-SMOTE-CGAN algorithm is also compared to other commonly used machine learning algorithms, such as KNN and Light GBM, and shows an overall improvement of 2% in terms of the ACC index compared to these algorithms. The AE-XGB-SMOTE-CGAN algorithm also outperforms KNN in terms of the MCC index by 30% when the threshold is set to 0.35. This indicates that the AE-XGB-SMOTE-CGAN algorithm has higher accuracy, true positive rate, true negative rate, and Matthew’s correlation coefficient, making it a promising method for detecting credit card fraud.

multidisciplinary sciences
Applying Hybrid Graph Neural Networks to Strengthen Credit Risk Analysis

Mengfang Sun,Wenying Sun,Ying Sun,Shaobo Liu,Mohan Jiang,Zhen Xu

2024-10-06

Abstract:This paper presents a novel approach to credit risk prediction by employing Graph Convolutional Neural Networks (GCNNs) to assess the creditworthiness of borrowers. Leveraging the power of big data and artificial intelligence, the proposed method addresses the challenges faced by traditional credit risk assessment models, particularly in handling imbalanced datasets and extracting meaningful features from complex relationships. The paper begins by transforming raw borrower data into graph-structured data, where borrowers and their relationships are represented as nodes and edges, respectively. A classic subgraph convolutional model is then applied to extract local features, followed by the introduction of a hybrid GCNN model that integrates both local and global convolutional operators to capture a comprehensive representation of node features. The hybrid model incorporates an attention mechanism to adaptively select features, mitigating issues of over-smoothing and insufficient feature consideration. The study demonstrates the potential of GCNNs in improving the accuracy of credit risk prediction, offering a robust solution for financial institutions seeking to enhance their lending decision-making processes.

Machine Learning
Classification of Imbalanced Credit scoring data sets Based on Ensemble Method with the Weighted-Hybrid-Sampling

Xiaofan Liua,Zuoquan Zhanga,Di Wanga

DOI: https://doi.org/10.48550/arXiv.2102.04721

IF: 5.414

2021-02-09

Machine Learning

Abstract:In the era of big data, the utilization of credit-scoring models to determine the credit risk of applicants accurately becomes a trend in the future. The conventional machine learning on credit scoring data sets tends to have poor classification for the minority class, which may bring huge commercial harm to banks. In order to classify imbalanced data sets, we propose a new ensemble algorithm, namely, Weighted-Hybrid-Sampling-Boost (WHSBoost). In data sampling, we process the imbalanced data sets with weights by the Weighted-SMOTE method and the Weighted-Under-Sampling method, and thus obtain a balanced training sample data set with equal weight. In ensemble algorithm, each time we train the base classifier, the balanced data set is given by the method above. In order to verify the applicability and robustness of the WHSBoost algorithm, we performed experiments on the simulation data sets, real benchmark data sets and real credit scoring data sets, comparing WHSBoost with SMOTE, SMOTEBoost and HSBoost based on SVM, BPNN, DT and KNN.
Data Augmentation Classifier for Imbalanced Fault Classification

Xiaoyu Jiang,Zhiqiang Ge

DOI: https://doi.org/10.1109/tase.2020.2998467

IF: 6.636

2020-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:The problem of fault classification in industry has been studied extensively. Most classification algorithms are modeled on the premise of data balance. However, the difficulty of collecting industrial data in different modes is quite different. This inevitably leads to data imbalance, which will adversely affect the fault classification performance. This article proposes a novel data augmentation classifier (DAC) for imbalanced fault classification. Data augmentation based on generative adversarial networks (GANs) is an effective way to solve the problem of unbalanced classification. However, the randomness of the GAN generation process restricts the effect of data enhancement. DAC proposes a data selection strategy based on data filtering and data purification in model training to solve this problem. In addition, DAC combines supervised learning and data generation processes to obtain an end-to-end model. Meanwhile, multigenerator structure of DAC (MDAC) is proposed to solve the problem of incomplete learning of a single generator when data imbalances get complicated. The proposed DAC and MDAC are applied in two fault classification cases of the Tennessee Eastman (TE) benchmark process, results of which show superiority of DAC and MDAC compared to existing methods. Note to Practitioners-Data imbalances are common in fault classification and affect the effectiveness of modeling in industry. As a generative model, generative adversarial networks (GANs) provide new ideas for small-class data augmentation. However, the instability of its training process and the randomness of data generation affect the results of data augmentation. In this article, the GAN generation process is analyzed in detail. The results of the visualization indicate that no data generation was perfect at any one time. Based on the rules of GAN data generation, we propose a data selection strategy during training. High-quality data are selected for data augmentation through data filtering and data purification. Apart from this, we combine the training process of GAN and classification model for imbalanced data to reduce modeling time. Through industrial examples, we have evaluated the effectiveness of this method.
Imbalanced credit card fraud detection data: A solution based on hybrid neural network and clustering-based undersampling technique

Huajie Huang,Bo Liu,Xiaoyu Xue,Jiuxin Cao,Xinyi Chen

DOI: https://doi.org/10.1016/j.asoc.2024.111368

IF: 8.7

2024-03-01

Applied Soft Computing

Abstract:With the economy rapid development, the credit card business enjoys sustained growth, which leads to the frauds happen frequently. Recent years, the intelligence technology has been applied in fraud detection, but they still leave huge potential to improve reliability. Most of the existing researches designed the model only related to transaction information; however, the user’s background information and economy status may be helpful to find abnormal behavior. In view of this, we extract valuable features about individual and transaction information, which can reflect personal background and economic status. Meanwhile, in order to solve the problem of fraud detection and imbalanced class, we innovatively construct a fraud detect framework by learning user features and transaction features, which uses a h ybrid n eural n etwork with a c lustering-based u ndersampling tec h nique on i dentity and t ransaction features (HNN-CUHIT). To test the performance of the HNN-CUHIT in credit card fraud detection, we use a real dataset from a city bank during SARS-CoV2 in 2020 to conduct the experiments. In the imbalanced class problem, the experimental result indicates that the ratio of the number of the normal and fraud classes is 1:1 and then the model performance is optimal, while the F1-score is 0.0572 in HNN-CUHIT and is 0.0454 in CNN by ROS. In the fraud detection experiment, the F1-score is 0.0416 in HNN-CUHIT, getting the best performance, while it is 0.0360, 0.0284 and 0.0396 respectively in LR, RF and CNN. According to experimental results, the HNN-CUHIT performs better than other machine learning models in imbalanced class solutions and fraud detection. Our work provides a new approach to detect credit card fraud in the finance field.

computer science, artificial intelligence, interdisciplinary applications
RGAN-EL: A GAN and ensemble learning-based hybrid approach for imbalanced data classification

Hongwei Ding,Yu Sun,Zhenyu Wang,Nana Huang,Zhidong Shen,Xiaohui Cui

DOI: https://doi.org/10.1016/j.ipm.2022.103235

2022-12-22

Abstract:Imbalanced sample distribution is usually the main reason for the performance degradation of machine learning algorithms. Based on this, this study proposes a hybrid framework (RGAN-EL) combining generative adversarial networks and ensemble learning method to improve the classification performance of imbalanced data. Firstly, we propose a training sample selection strategy based on roulette wheel selection method to make GAN pay more attention to the class overlapping area when fitting the sample distribution. Secondly, we design two kinds of generator training loss, and propose a noise sample filtering method to improve the quality of generated samples. Then, minority class samples are oversampled using the improved RGAN to obtain a balanced training sample set. Finally, combined with the ensemble learning strategy, the final training and prediction are carried out. We conducted experiments on 41 real imbalanced data sets using two evaluation indexes: F1-score and AUC. Specifically, we compare RGAN-EL with six typical ensemble learning; RGAN is compared with three typical GAN models. The experimental results show that RGAN-EL is significantly better than the other six ensemble learning methods, and RGAN is greatly improved compared with three classical GAN models.

computer science, information systems,information science & library science
Imbalanced customer churn classification using a new multi-strategy collaborative processing method

Congjun Rao,Yaling Xu,Xinping Xiao,Fuyan Hu,Mark Goh

DOI: https://doi.org/10.1016/j.eswa.2024.123251

IF: 8.5

2024-01-30

Expert Systems with Applications

Abstract:The rapid advancement of big data and artificial intelligence heralds a dual-edged era of opportunities and challenges for the banking sector. Indeed, enhancing a model's capability to accurately classify imbalanced datasets represents a critical challenge within the field of customer churn prediction (CCP). In this paper, to address the challenges presented by the problem of imbalanced customer classification, a new multi-strategy collaborative processing method named IADASYN-FLCatBoost is proposed from dual perspectives: data and algorithm. At the data level, the traditional Adaptive Synthetic (ADASYN) sampling is improved, that is, the LOF (Local Outlier Factor) algorithm is introduced to eliminate outliers, and the classification features are specially processed to synthesize new minority class samples, thus an improved ADASYN (IADASYN) algorithm is obtained. At the algorithm level, the Focal Loss is embedded into the CatBoost ensemble learning framework to form a new Focal Loss-CatBoost (FLCatBoost) to make a focal-aware, cost-sensitive version of imbalanced customer churn prediction. Moreover, the empirical analysis is conducted in conjunction with the credit card customer dataset obtained from the Kaggle platform. The results of the staged comparison experiments show that the proposed method IADASYN-FLCatBoost in this paper shows the best prediction performance. Comparing the proposed method with 5 other imbalanced classification algorithms and 20 classifiers composed of classical sampling methods and ensemble learning algorithms, it is verified that the classification effect of the proposed method performs best, and the values of Recall , F 1 score, G-mean and Area under Precision-Recall curve ( AUPRC ) have been significantly improved. In addition, further verification of the model also proves that the proposed method has certain generalizability and is still valid for other banks and customer churn datasets of other industries.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
A Hybrid Model for Credit Risk Assessment: Empirical Validation by Real-World Credit Data

Guotai Chi,M. Islam,M. S. Uddin,Ying Zhou,Md. Asad Iqbal Chowdhury,Tabassum Habib

DOI: https://doi.org/10.21314/JRMV.2020.228

2019-08-27

Abstract:This paper examines which hybridization strategy is more suitable for credit risk assessment in the dynamic financial world. As such, we use extensive new data sets and develop different hybrid models by combining traditional statistical and modern artificial intelligence methods based on classification and clustering feature selection approaches. We find that a multilayer perceptron (MLP) combined with discriminant analysis or logistic regression (LR) can significantly improve classification accuracy compared with other single and hybrid classifiers. In particular, the findings of our empirical analysis, statistical significance test and expected cost of misclassification test confirm the superiority of the clustering-based LR C MLP hybrid classifier in improving prediction accuracy in maximum performance criteria. To check the efficiency and viability of the proposed model, we use three imbalanced data sets: Chinese farmer credit, Chinese small and medium-sized enterprise (SME) credit and German credit. We also use Australian credit data for further authentication and a robustness check. The first two data sets are private and high dimensional, whereas the second two are mostly used, publicly available and low dimensional. Thus, our findings are relevant for many areas of credit risk, such as SME, farmer and consumer credit risk modeling.

Economics,Computer Science,Business
Resampling Techniques Study on Class Imbalance Problem in Credit Risk Prediction

Zixue Zhao,Tianxiang Cui,Shusheng Ding,Jiawei Li,Anthony Graham Bellotti

DOI: https://doi.org/10.3390/math12050701

IF: 2.4

2024-02-29

Mathematics

Abstract:Credit risk prediction heavily relies on historical data provided by financial institutions. The goal is to identify commonalities among defaulting users based on existing information. However, data on defaulters is often limited, leading to a concentration of credit data where positive samples (defaults) are significantly fewer than negative samples (nondefaults). It poses a serious challenge known as the class imbalance problem, which can substantially impact data quality and predictive model effectiveness. To address the problem, various resampling techniques have been proposed and studied extensively. However, despite ongoing research, there is no consensus on the most effective technique. The choice of resampling technique is closely related to the dataset size and imbalance ratio, and its effectiveness varies across different classifiers. Moreover, there is a notable gap in research concerning suitable techniques for extremely imbalanced datasets. Therefore, this study aims to compare popular resampling techniques across different datasets and classifiers while also proposing a novel hybrid sampling method tailored for extremely imbalanced datasets. Our experimental results demonstrate that this new technique significantly enhances classifier predictive performance, shedding light on effective strategies for managing the class imbalance problem in credit risk prediction.

mathematics
Generative Adversarial Fusion Network for Class Imbalance Credit Scoring

Kai Lei,Yuexiang Xie,Shangru Zhong,Jingchao Dai,Min Yang,Ying Shen

DOI: https://doi.org/10.1007/s00521-019-04335-1

2019-01-01

Abstract:Credit scoring on class imbalance data, where the class of defaulters is insufficiently represented compared with the class of non-defaulters, is an important but challenging task. In this paper, we propose an imbalanced generative adversarial fusion network (IGAFN) to cope with the class imbalance credit scoring based on multi-source heterogeneous credit data. Concretely, we design a fusion module to integrate the heterogeneous credit data from multiple sources into a unified latent feature space. A generative adversarial network-based balance module is then designed to generate latent representations of new samples for the minority class of the imbalanced datasets. The performance of IGAFN is compared against multiple conventional machine learning and deep learning algorithms. Extensive experiments show that the proposed IGAFN exhibits significantly better performance than the compared methods on two real-life datasets.
A hybrid sampling method for highly imbalanced and overlapped data classification with complex distribution

Yansong Liu,Li Zhu,Lei Ding,He Sui,Wenli Shang

DOI: https://doi.org/10.1016/j.ins.2024.120117

IF: 8.1

2024-01-14

Information Sciences

Abstract:Class imbalance and overlap coupling is the primary cause of performance degradation for classifiers. Unfortunately, it always occurs. In this paper, we propose a hybrid sampling method derived from optimized generative adversarial network and natural neighbor search (HD-GNNS) for this scenario. The new approach considers both the global distribution and local distribution of the minority class to improve the data distribution fundamentally. First, natural neighbor search with Fisher's discriminant ratio is conducted to screen overlapped sample subset and remove noise samples. It effectively overcomes the parameter sensitivity by adaptively determining the search radius. Then, an encoder with squeeze and excite block is introduced into generative adversarial network, and the structure of generative adversarial network is optimized with cross-layer and low-rank matrix. It better captures the distribution characteristics of minority samples in overlapped subset for oversampling. Afterwards, the local density of majority samples in overlapped subset is calculated by the aforementioned natural neighbor search method, and Thornton's Separation Index is used to implement under-sampling adaptively. We evaluate the proposed approach on 1 artificial dataset, 14 UCI datasets and 8 real-word datasets. The experimental results show that the proposed HD-GNNS exhibits more impressive performance compared to other benchmark methods.

computer science, information systems
An intra-class distribution-focused generative adversarial network approach for imbalanced tabular data learning

Qiuling Chen,Ayong Ye,Yuexin Zhang,Jianwei Chen,Chuan Huang

DOI: https://doi.org/10.1007/s13042-023-02048-5

2024-01-04

International Journal of Machine Learning and Cybernetics

Abstract:Data imbalance is a critical factor that adversely affects the performance of machine learning algorithms. It leads to deviations in decision boundaries, resulting in biased predictions towards the majority class and inaccurate classification of the minority class. Although oversampling the minority class using deep generative models is a popular strategy, many existing methods focus solely on enhancing data for the minority class while overlooking the distribution relationship within and between classes. Therefore, we propose an oversampling method that merges unsupervised clustering and generative adversarial network (GAN) to facilitate the imbalanced tabular data learning. First, we perform preprocessing (clustering) on the original data, remove clusters that do not require sampling and generate more samples for sparsely distributed minority class clusters to achieve sample balance within the minority class. Moreover, we design a CTGAN-based auxiliary classifier GAN (ACCTGAN) to generate the minority class. It enhances the semantic integrity of the synthetic data and avoids generating noisy samples. We conducted validation experiments comparing our approach to 7 typical methods on 12 real tabular datasets. Our method shows excellent performance in F1-measure and area under the curve (AUC), obtaining 19 and 20 best results on the three classifiers, respectively. It significantly enhances classification results and demonstrates good robustness and stability.

computer science, artificial intelligence
A Hybrid Algorithm-Level Ensemble Model for Imbalanced Credit Default Prediction in the Energy Industry

Kui Wang,Jie Wan,Gang Li,Hao Sun

DOI: https://doi.org/10.3390/en15145206

IF: 3.2

2022-07-19

Energies

Abstract:Credit default prediction for the energy industry is essential to promoting the healthy development of the energy industry in China. While previous studies have constructed various credit default prediction models with brilliant performance, the class-imbalance problem in the credit default dataset cannot be ignored, where the numbers of credit default cases are usually much smaller than the number of non-default ones. To address the class-imbalance problem, we proposed a novel CT-XGBoost model, which adds to XGBoost with two algorithm-level methods for class imbalance, including the cost-sensitive strategy and threshold method. Based on the credit default dataset consisting of energy corporates in western China, which suffers from the class-imbalance problem, the CT-XGBoost model achieves better performance than the conventional models. The results indicate that the proposed model can efficiently alleviate the inherent class-imbalance problem in the credit default dataset. Moreover, we analyze how the prediction performance is influenced by different parameter settings in the cost-sensitive strategy and threshold method. This study can help market investors and regulators precisely assess the credit risk in the energy industry and provides theoretical guidance to solving the class-imbalance problem in credit default prediction.

energy & fuels

A method of classifying imbalanced credit data based on the AC-CTGAN hybrid sampling algorithm

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

Research on Default Classification of Unbalanced Credit Data Based on PixelCNN-WGAN

A ResNet-LSTM Based Credit Scoring Approach for Imbalanced Data

A Novel Multi-Stage Ensemble Model With a Hybrid Genetic Algorithm for Credit Scoring on Imbalanced Data

CDGAT: a graph attention network method for credit card defaulters prediction

FinGAN: Generative Adversarial Network for Analytical Customer Relationship Management in Banking and Insurance

CTCN: a novel credit card fraud detection method based on Conditional Tabular Generative Adversarial Networks and Temporal Convolutional Network

A novel method for detecting credit card fraud problems

Applying Hybrid Graph Neural Networks to Strengthen Credit Risk Analysis

Classification of Imbalanced Credit scoring data sets Based on Ensemble Method with the Weighted-Hybrid-Sampling

Data Augmentation Classifier for Imbalanced Fault Classification

Imbalanced credit card fraud detection data: A solution based on hybrid neural network and clustering-based undersampling technique

RGAN-EL: A GAN and ensemble learning-based hybrid approach for imbalanced data classification

Imbalanced customer churn classification using a new multi-strategy collaborative processing method

A Hybrid Model for Credit Risk Assessment: Empirical Validation by Real-World Credit Data

Resampling Techniques Study on Class Imbalance Problem in Credit Risk Prediction

Generative Adversarial Fusion Network for Class Imbalance Credit Scoring

A hybrid sampling method for highly imbalanced and overlapped data classification with complex distribution

An intra-class distribution-focused generative adversarial network approach for imbalanced tabular data learning

A Hybrid Algorithm-Level Ensemble Model for Imbalanced Credit Default Prediction in the Energy Industry