Programming Languages for Real-Time Applications Executing on Parallel Hardware

A. Burns

DOI: https://doi.org/10.1007/978-3-642-21338-0_15

2011-06-20

Abstract:

What problem does this paper attempt to address?

IDA-GAN: A Novel Imbalanced Data Augmentation GAN

Hao Yang,Yun Zhou

DOI: https://doi.org/10.1109/icpr48806.2021.9411996

2021-01-10

Abstract:Class imbalance is a widely existed and challenging problem in real-world applications such as disease diagnosis, fraud detection, network intrusion detection and so on. Due to the scarce of data, it could significantly deteriorate the accuracy of classification. To address this challenge, we propose a novel Imbalanced Data Augmentation Generative Adversarial Networks (GAN) named IDA-GAN as an augmentation tool to deal with the imbalanced dataset. This is a great challenge because it is hard to train a GAN model under this situation. We address this issue by coupling variational autoencoder along with GAN training. In this paper, specifically, we introduce the variational autoencoder to learn the majority and minority class distributions in the latent space, and use the generative model to utilize each class distribution for the subsequent GAN training. The generative model learns useful features to generate target minority-class samples. Compared with the state-of-the-art GAN model, the experimental results demonstrate that our proposed IDA-GAN could generate more diverse minority samples with better qualities, and it could benefits the imbalanced classification task in terms of several widely-used evaluation metrics on five benchmark datasets: MNIST, Fashion-MNIST, SVHN, CIFAR-10 and GTSRB.
CMAGAN: classifier-aided minority augmentation generative adversarial networks for industrial imbalanced data and its application to fault prediction

Wen-Jie Wang,Zhao Liu,Ping Zhu

DOI: https://doi.org/10.1007/s40436-024-00496-y

IF: 3.837

2024-06-19

Advances in Manufacturing

Abstract:Class imbalance is a common characteristic of industrial data that adversely affects industrial data mining because it leads to the biased training of machine learning models. To address this issue, the augmentation of samples in minority classes based on generative adversarial networks (GANs) has been demonstrated as an effective approach. This study proposes a novel GAN-based minority class augmentation approach named classifier-aided minority augmentation generative adversarial network (CMAGAN). In the CMAGAN framework, an outlier elimination strategy is first applied to each class to minimize the negative impacts of outliers. Subsequently, a newly designed boundary-strengthening learning GAN (BSLGAN) is employed to generate additional samples for minority classes. By incorporating a supplementary classifier and innovative training mechanisms, the BSLGAN focuses on learning the distribution of samples near classification boundaries. Consequently, it can fully capture the characteristics of the target class and generate highly realistic samples with clear boundaries. Finally, the new samples are filtered based on the Mahalanobis distance to ensure that they are within the desired distribution. To evaluate the effectiveness of the proposed approach, CMAGAN was used to solve the class imbalance problem in eight real-world fault-prediction applications. The performance of CMAGAN was compared with that of seven other algorithms, including state-of-the-art GAN-based methods, and the results indicated that CMAGAN could provide higher-quality augmented results.

materials science, multidisciplinary,engineering, manufacturing
Data Augmentation Classifier for Imbalanced Fault Classification

Xiaoyu Jiang,Zhiqiang Ge

DOI: https://doi.org/10.1109/tase.2020.2998467

IF: 6.636

2020-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:The problem of fault classification in industry has been studied extensively. Most classification algorithms are modeled on the premise of data balance. However, the difficulty of collecting industrial data in different modes is quite different. This inevitably leads to data imbalance, which will adversely affect the fault classification performance. This article proposes a novel data augmentation classifier (DAC) for imbalanced fault classification. Data augmentation based on generative adversarial networks (GANs) is an effective way to solve the problem of unbalanced classification. However, the randomness of the GAN generation process restricts the effect of data enhancement. DAC proposes a data selection strategy based on data filtering and data purification in model training to solve this problem. In addition, DAC combines supervised learning and data generation processes to obtain an end-to-end model. Meanwhile, multigenerator structure of DAC (MDAC) is proposed to solve the problem of incomplete learning of a single generator when data imbalances get complicated. The proposed DAC and MDAC are applied in two fault classification cases of the Tennessee Eastman (TE) benchmark process, results of which show superiority of DAC and MDAC compared to existing methods. Note to Practitioners-Data imbalances are common in fault classification and affect the effectiveness of modeling in industry. As a generative model, generative adversarial networks (GANs) provide new ideas for small-class data augmentation. However, the instability of its training process and the randomness of data generation affect the results of data augmentation. In this article, the GAN generation process is analyzed in detail. The results of the visualization indicate that no data generation was perfect at any one time. Based on the rules of GAN data generation, we propose a data selection strategy during training. High-quality data are selected for data augmentation through data filtering and data purification. Apart from this, we combine the training process of GAN and classification model for imbalanced data to reduce modeling time. Through industrial examples, we have evaluated the effectiveness of this method.
Collaborative Discrimination-Enabled Generative Adversarial Network (CoD-GAN) for the Data Augmentation in Imbalanced Classification

Chenang Liu,Yuxuan Li,Ziyang Zhang

DOI: https://doi.org/10.1109/CASE49997.2022.9926707

2022-08-20

Abstract:Classification models have been widely applied to detect anomalies in many real-world fields, such as manufacturing process monitoring and disease early detection. However, the classification models may suffer from the data imbalance issue, as the abnormal/unhealthy states are usually rare events in regular data collection. Imbalanced data may result in significant training bias, leading to unsatisfactory classification accuracy. Incorporating data augmentation techniques, such as the popular generative adversarial networks (GAN), is a common strategy to eliminate the data imbalanced issue in classification. However, the performance of most GAN-based approaches may be unsatisfactory when the size of available training samples is small. To address this issue in GAN, the paper develops a novel collaborative discrimination-enabled GAN (CoD-GAN) to enhance its discrimination robustness. With the proposed collaborative discrimination framework, CoD-GAN is able to perform discrimination more effectively when the available real data is limited. Thus, the synthesized samples will be more effective, and the classification accuracy can be improved. The effectiveness of the proposed CoD-GAN has been validated by both numerical simulation data and real-world dataset. The results have demonstrated that the proposed method can further improve the data augmentation capability of GAN for imbalanced data classification.

Engineering,Computer Science
IB-GAN: A Unified Approach for Multivariate Time Series Classification under Class Imbalance

Grace Deng,Cuize Han,Tommaso Dreossi,Clarence Lee,David S. Matteson

DOI: https://doi.org/10.48550/arXiv.2110.07460

2021-10-14

Abstract:Classification of large multivariate time series with strong class imbalance is an important task in real-world applications. Standard methods of class weights, oversampling, or parametric data augmentation do not always yield significant improvements for predicting minority classes of interest. Non-parametric data augmentation with Generative Adversarial Networks (GANs) offers a promising solution. We propose Imputation Balanced GAN (IB-GAN), a novel method that joins data augmentation and classification in a one-step process via an imputation-balancing approach. IB-GAN uses imputation and resampling techniques to generate higher quality samples from randomly masked vectors than from white noise, and augments classification through a class-balanced set of real and synthetic samples. Imputation hyperparameter $p_{miss}$ allows for regularization of classifier variability by tuning innovations introduced via generator imputation. IB-GAN is simple to train and model-agnostic, pairing any deep learning classifier with a generator-discriminator duo and resulting in higher accuracy for under-observed classes. Empirical experiments on open-source UCR data and proprietary 90K product dataset show significant performance gains against state-of-the-art parametric and GAN baselines.

Machine Learning
Ensemble Data Augmentation for Imbalanced Fault Diagnosis.

Xiaoyu Jiang,Junhua Zheng,Xinzhen Zhuang,Zhiqiang Ge

DOI: https://doi.org/10.1109/tim.2023.3307757

IF: 5.6

2023-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:Data imbalance is a prevalent issue in industrial fault diagnosis, and generative adversarial networks (GANs) have gained significant attention and application in recent years as a solution. GANs address data imbalance by augmenting minority-category data, leveraging their strong generation capability. However, the training process of GANs often suffers from instability, resulting in a skewed distribution of the generated data. To address this challenge, this article proposes a novel GAN-based ensemble data augmentation framework that draws inspiration from ensemble learning principles. The framework aims to enhance data augmentation through the cooperative and competitive utilization of generated data. In the cooperative aspect, we introduce multisource data augmentation (MSDA) to mitigate the problem of skewed generated data by combining multiple independently trained GANs as generative sources. To further improve the diversity and efficiency of training multiple GANs, we incorporate cross-training and parallel training techniques into the cooperative MSDA (referred to as ct-MSDA). These techniques provide significant support for the practical application of our proposed method. In addition, in the competitive aspect, we designed a data filtering method for df-ct-MSDA. This method evaluates the generated data and selects those with higher scores for participation in the training process. Finally, the effectiveness of our ensemble data augmentation framework is demonstrated through exemplary industrial cases exhibiting typical data imbalance issues. Our proposed method showcases outstanding performance in these scenarios, further validating its superiority.
Enhancing and improving the performance of imbalanced class data using novel GBO and SSG: A comparative analysis

Md Manjurul Ahsan,Md Shahin Ali,Zahed Siddique

DOI: https://doi.org/10.1016/j.neunet.2024.106157

IF: 7.8

2024-05-01

Neural Networks

Abstract:Class imbalance problem (CIP) in a dataset is a major challenge that significantly affects the performance of Machine Learning (ML) models resulting in biased predictions. Numerous techniques have been proposed to address CIP, including, but not limited to, Oversampling, Undersampling, and cost-sensitive approaches. Due to its ability to generate synthetic data, oversampling techniques such as the Synthetic Minority Oversampling Technique (SMOTE) are the most widely used methodology by researchers. However, one of SMOTE's potential disadvantages is that newly created minor samples overlap with major samples. Therefore, the probability of ML models' biased performance toward major classes increases. Generative adversarial network (GAN) has recently garnered much attention due to their ability to create real samples. However, GAN is hard to train even though it has much potential. Considering these opportunities, this work proposes two novel techniques: GAN-based Oversampling (GBO) and Support Vector Machine-SMOTE-GAN (SSG) to overcome the limitations of the existing approaches. The preliminary results show that SSG and GBO performed better on the nine imbalanced benchmark datasets than several existing SMOTE-based approaches. Additionally, it can be observed that the proposed SSG and GBO methods can accurately classify the minor class with more than 90% accuracy when tested with 20%, 30%, and 40% of the test data. The study also revealed that the minor sample generated by SSG demonstrates Gaussian distributions, which is often difficult to achieve using original SMOTE and SVM-SMOTE.

computer science, artificial intelligence,neurosciences
Distribution Enhancement for Imbalanced Data with Generative Adversarial Network

Yueqi Chen,Witold Pedrycz,Tingting Pan,Jian Wang,Jie Yang

DOI: https://doi.org/10.1002/adts.202400234

2024-06-23

Advanced Theory and Simulations

Abstract:This paper introduces three strategies to improve the ability of GAN to handle imbalanced data. The first strategy is to inject prior knowledge into the latent space of GAN. The second strategy is to inject random noise into the discriminator. The third one is to use multiple GANs to learn comprehensive probability distributions of positive class based on multi‐scale data. Tackling imbalanced problems encountered in real‐world applications poses a challenge at present. Oversampling is a widely useful method for imbalanced tabular data. However, most traditional oversampling methods generate samples by interpolation of minority (positive) class, failing to entirely capture the probability density distribution of the original data. In this paper, a novel oversampling method is presented based on generative adversarial network (GAN) with the originality of introducing three strategies to enhance the distribution of the positive class, called GAN‐E. The first strategy is to inject prior knowledge of positive class into the latent space of GAN, improving sample emulation. The second strategy is to inject random noise containing this prior knowledge into both original and generated positive samples to stretch the learning space of the discriminator of GAN. The third one is to use multiple GANs to learn comprehensive probability distributions of positive class based on multi‐scale data to eliminate the influence of GAN on generating aggregate samples. The experimental results and statistical tests obtained on 18 commonly used imbalanced datasets show that the proposed method comes with a better performance in terms of G‐mean, F‐measure, AUC and accuracy than 14 other rebalanced methods.

multidisciplinary sciences
BAGAN: Data Augmentation with Balancing GAN

Giovanni Mariani,Florian Scheidegger,Roxana Istrate,Costas Bekas,Cristiano Malossi

DOI: https://doi.org/10.48550/arXiv.1803.09655

2018-03-26

Computer Vision and Pattern Recognition

Abstract:Image classification datasets are often imbalanced, characteristic that negatively affects the accuracy of deep-learning classifiers. In this work we propose balancing GAN (BAGAN) as an augmentation tool to restore balance in imbalanced datasets. This is challenging because the few minority-class images may not be enough to train a GAN. We overcome this issue by including during the adversarial training all available images of majority and minority classes. The generative model learns useful features from majority classes and uses these to generate images for minority classes. We apply class conditioning in the latent space to drive the generation process towards a target class. The generator in the GAN is initialized with the encoder module of an autoencoder that enables us to learn an accurate class-conditioning in the latent space. We compare the proposed methodology with state-of-the-art GANs and demonstrate that BAGAN generates images of superior quality when trained with an imbalanced dataset.
GAN based Data Augmentation to Resolve Class Imbalance

Sairamvinay Vijayaraghavan,Terry Guan,Jason,Song

DOI: https://doi.org/10.48550/arXiv.2206.05840

2022-06-13

Abstract:The number of credit card fraud has been growing as technology grows and people can take advantage of it. Therefore, it is very important to implement a robust and effective method to detect such frauds. The machine learning algorithms are appropriate for these tasks since they try to maximize the accuracy of predictions and hence can be relied upon. However, there is an impending flaw where in machine learning models may not perform well due to the presence of an imbalance across classes distribution within the sample set. So, in many related tasks, the datasets have a very small number of observed fraud cases (sometimes around 1 percent positive fraud instances found). Therefore, this imbalance presence may impact any learning model's behavior by predicting all labels as the majority class, hence allowing no scope for generalization in the predictions made by the model. We trained Generative Adversarial Network(GAN) to generate a large number of convincing (and reliable) synthetic examples of the minority class that can be used to alleviate the class imbalance within the training set and hence generalize the learning of the data more effectively.

Machine Learning,Artificial Intelligence
SGBGAN: minority class image generation for class-imbalanced datasets

Qian Wan,Wenhui Guo,Yanjiang Wang

DOI: https://doi.org/10.1007/s00138-023-01506-y

IF: 2.983

2024-01-31

Machine Vision and Applications

Abstract:Class imbalance frequently arises in the context of image classification. Conventional generative adversarial networks (GANs) have a tendency to produce samples from the majority class when trained on class-imbalanced datasets. To address this issue, the Balancing GAN with gradient penalty (BAGAN-GP) has been proposed, but the outcomes may still exhibit a bias toward the majority categories when the similarity between images from different categories is substantial. In this study, we introduce a novel approach called the Pre-trained Gated Variational Autoencoder with Self-attention for Balancing Generative Adversarial Network (SGBGAN) as an image augmentation technique for generating high-quality images. The proposed method utilizes a Gated Variational Autoencoder with Self-attention (SA-GVAE) to initialize the GAN and transfers pre-trained SA-GVAE weights to the GAN. Our experimental results on Fashion-MNIST, CIFAR-10, and a highly unbalanced medical image dataset demonstrate that the SGBGAN outperforms other state-of-the-art methods. Results on Fréchet inception distance (FID) and structural similarity measures (SSIM) show that our model overcomes the instability problems that exist in other GANs. Especially on the Cells dataset, the FID of a minority class increases up to 23.09% compared to the latest BAGAN-GP, and the SSIM of a minority class increases up to 10.81%. It is proved that SGBGAN overcomes the class imbalance restriction and generates high-quality minority class images.

computer science, cybernetics, artificial intelligence,engineering, electrical & electronic
Multi-class imbalanced image classification using conditioned GANs

M R Pavan Kumar,Prabhu Jayagopal

DOI: https://doi.org/10.1007/s13735-021-00213-6

2021-09-01

International Journal of Multimedia Information Retrieval

Abstract:The problem of data skewness, class imbalance, data scarcity and noise limits the application of machine learning and deep learning models in applications like anomaly detection, fraud detection, intrusion detection, fault diagnosis, machine-to-machine communication, etc. Performance of supervised learning leans towards majority class and fails to generalize testing data in class imbalance and noisy data problems. Using neural-based data augmentation techniques for data generation and deep convolutional models for classification would enhance the performance of the applications mentioned above. Recently, GANs (generative adversarial networks) showed significant improvements in generating images. In this paper, a model that uses a conditioned deep convolutional GAN and an auxiliary classifier are proposed to tackle the aforementioned issues. The conditioned GAN is used for data generation of minority classes images and noisy images. Another auxiliary deep convolutional model is employed for the classification of images on data augmented dataset. Also, a multi-hinge loss is employed in both the data augmentation and classification tasks. The effectiveness of the proposed model is investigated on the quality of generated images and classification metrics using four publicly available popular datasets: MNIST, EMNIST, CIFAR10, and SVHN. The proposed model has shown significant improvements over the other often used models of data augmentation and multi-class imbalance image classification in terms of generated samples and classification accuracy.

computer science, artificial intelligence, software engineering
A tutorial on generative adversarial networks with application to classification of imbalanced data

Yuxiao Huang,Kara G. Fields,Yan Ma

DOI: https://doi.org/10.1002/sam.11570

2021-12-31

Abstract:A challenge unique to classification model development is imbalanced data. In a binary classification problem, class imbalance occurs when one class, the minority group, contains significantly fewer samples than the other class, the majority group. In imbalanced data, the minority class is often the class of interest (e.g., patients with disease). However, when training a classifier on imbalanced data, the model will exhibit bias towards the majority class and, in extreme cases, may ignore the minority class completely. A common strategy for addressing class imbalance is data augmentation. However, traditional data augmentation methods are associated with overfitting, where the model is fit to the noise in the data. In this tutorial we introduce an advanced method for data augmentation: Generative Adversarial Networks (GANs). The advantages of GANs over traditional data augmentation methods are illustrated using the Breast Cancer Wisconsin study. To promote the adoption of GANs for data augmentation, we present an end-to-end pipeline that encompasses the complete life cycle of a machine learning project along with alternatives and good practices both in the paper and in a separate video. Our code, data, full results and video tutorial are publicly available in the paper's github repository.

computer science, artificial intelligence, interdisciplinary applications,statistics & probability
Deep Learning for Imbalance Data Classification using Class Expert Generative Adversarial Network

Fanny,Tjeng Wawan Cenggoro

DOI: https://doi.org/10.48550/arXiv.1807.04585

2018-07-13

Abstract:Without any specific way for imbalance data classification, artificial intelligence algorithm cannot recognize data from minority classes easily. In general, modifying the existing algorithm by assuming that the training data is imbalanced, is the only way to handle imbalance data. However, for a normal data handling, this way mostly produces a deficient result. In this research, we propose a class expert generative adversarial network (CE-GAN) as the solution for imbalance data classification. CE-GAN is a modification in deep learning algorithm architecture that does not have an assumption that the training data is imbalance data. Moreover, CE-GAN is designed to identify more detail about the character of each class before classification step. CE-GAN has been proved in this research to give a good performance for imbalance data classification.

Machine Learning,Computer Vision and Pattern Recognition
An intra-class distribution-focused generative adversarial network approach for imbalanced tabular data learning

Qiuling Chen,Ayong Ye,Yuexin Zhang,Jianwei Chen,Chuan Huang

DOI: https://doi.org/10.1007/s13042-023-02048-5

2024-01-04

International Journal of Machine Learning and Cybernetics

Abstract:Data imbalance is a critical factor that adversely affects the performance of machine learning algorithms. It leads to deviations in decision boundaries, resulting in biased predictions towards the majority class and inaccurate classification of the minority class. Although oversampling the minority class using deep generative models is a popular strategy, many existing methods focus solely on enhancing data for the minority class while overlooking the distribution relationship within and between classes. Therefore, we propose an oversampling method that merges unsupervised clustering and generative adversarial network (GAN) to facilitate the imbalanced tabular data learning. First, we perform preprocessing (clustering) on the original data, remove clusters that do not require sampling and generate more samples for sparsely distributed minority class clusters to achieve sample balance within the minority class. Moreover, we design a CTGAN-based auxiliary classifier GAN (ACCTGAN) to generate the minority class. It enhances the semantic integrity of the synthetic data and avoids generating noisy samples. We conducted validation experiments comparing our approach to 7 typical methods on 12 real tabular datasets. Our method shows excellent performance in F1-measure and area under the curve (AUC), obtaining 19 and 20 best results on the three classifiers, respectively. It significantly enhances classification results and demonstrates good robustness and stability.

computer science, artificial intelligence
RGAN-EL: A GAN and ensemble learning-based hybrid approach for imbalanced data classification

Hongwei Ding,Yu Sun,Zhenyu Wang,Nana Huang,Zhidong Shen,Xiaohui Cui

DOI: https://doi.org/10.1016/j.ipm.2022.103235

2022-12-22

Abstract:Imbalanced sample distribution is usually the main reason for the performance degradation of machine learning algorithms. Based on this, this study proposes a hybrid framework (RGAN-EL) combining generative adversarial networks and ensemble learning method to improve the classification performance of imbalanced data. Firstly, we propose a training sample selection strategy based on roulette wheel selection method to make GAN pay more attention to the class overlapping area when fitting the sample distribution. Secondly, we design two kinds of generator training loss, and propose a noise sample filtering method to improve the quality of generated samples. Then, minority class samples are oversampled using the improved RGAN to obtain a balanced training sample set. Finally, combined with the ensemble learning strategy, the final training and prediction are carried out. We conducted experiments on 41 real imbalanced data sets using two evaluation indexes: F1-score and AUC. Specifically, we compare RGAN-EL with six typical ensemble learning; RGAN is compared with three typical GAN models. The experimental results show that RGAN-EL is significantly better than the other six ensemble learning methods, and RGAN is greatly improved compared with three classical GAN models.

computer science, information systems,information science & library science
Efficient Generative Adversarial Networks for Imbalanced Traffic Collision Datasets

Mu-Yen Chen,Hsiu-Sen Chiang,Wei-Kai Huang

DOI: https://doi.org/10.1109/tits.2022.3162395

IF: 8.5

2022-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Rapid breakthroughs in information technologies have driven substantial developments in artificial intelligence applications, particularly the widespread use of deep learning techniques in domains such as speech, image and text recognition. However, real world data distribution applications suffer from significant problems including data imbalance which can easily lead to machine learning biased towards the side with more data, resulting in inaccurate classification or prediction results. Therefore, effectively addressing data imbalance is a pressing research topic. Generative Adversarial Networks (GAN) addresses data imbalance, but is prone to vanishing gradients. Recent work has thus focused on improving the GAN architecture to resolve this problem. The present research extends these efforts, applying C4.5, Random Forest, Support Vector Machine, K-Nearest Neighbor and Naïve Bayes classification algorithms to a single imbalanced traffic collision dataset to identify methods for improving prediction results. Experimental results show that classification performance significantly improves after data augmentation using Synthetic Minority Oversampling Technique, GAN, Conditional GAN, and Gaussian Discriminant Analysis GAN as compared with the non-augmented dataset. In addition, the Gaussian Discriminant Analysis GAN with Naïve Bayes classifier produces a dataset that optimizes classification performance for traffic accident prediction at highway intersections.

engineering, electrical & electronic,transportation science & technology, civil
DGM: a data generative model to improve minority class presence in anomaly detection domain

Gcinizwe Dlamini,Muhammad Fahim

DOI: https://doi.org/10.1007/s00521-021-05993-w

2021-04-17

Neural Computing and Applications

Abstract:Anomaly detection is a process to identify abnormal behavior that does not confirm the normal behavior. The abnormal behavior clues are few because it appears rarely. To detect each abnormal behavior, the problem is transformed into a multi-class classification task where it lies into data imbalance representation. In data imbalance setting, minority classes are over-sampled to improve the performance of the classifier. Existing methods are unable to learn the distribution of the minority class and effects the performance of classifier. In this research, we introduced a data generative model (DGM) to improve the minority class presence in the anomaly detection domain. Our approach is based on a conditional generative adversarial network to generate synthetic samples for minority classes. It includes the KL-divergence to guide the model towards the true learning of minority class distribution. In this way, model learns the complex underlying data distribution and generates new samples. We performed experiments over the two benchmark datasets NSL-KDD and UNSW-NB15 that are publicly available to demonstrate the effectiveness of our approach. Furthermore, the comparative analysis with the existing approaches confirms the stability and superiority of our presented model.

computer science, artificial intelligence
Using Bidirectional GAN with Improved Training Architecture for Imbalanced Tasks

Wenjia Zhang,Peng Peng,Heming Zhang

DOI: https://doi.org/10.1109/CSCWD49262.2021.9437750

2021-01-01

Abstract:Classification with an imbalanced dataset has been a hard task for a long time. As generative models become more and more attractive, many researchers try to use these methods to address the imbalance problem. In this paper, we employ Bidirectional Generative Adversarial Networks (BIGAN) with improved training architecture as an oversampling method for minority class. We introduce an additional feedback by making use of the encoder E and further enhance the training of generator G. We conduct the qualitative and quantitative assessment on generated samples, and it shows that under the premise of ensuring diversity, the generated data tend to have less noise. Using it to perform data augmentation in training process, our method has been proved to get a better performance than original GAN-based method on multi-class imbalanced classification task.
An ensemble oversampling method for imbalanced classification with prior knowledge via generative adversarial network

Yulin Zhang,Yuchen Liu,Yan Wang,Jie Yang

DOI: https://doi.org/10.1016/j.chemolab.2023.104775

IF: 4.175

2023-02-01

Chemometrics and Intelligent Laboratory Systems

Abstract:Currently, an increasing number of real-world applications show characteristics of class-imbalance classification suffering from severe class distribution skewing, thus requiring brand new algorithms to learn from imbalanced datasets. In this paper, a novel oversampling method using GAN framework is proposed for numerical imbalanced data, namely G-GAN. In the method, a Gaussian distribution of minority samples is estimated to get prior knowledge of minority class for the latent space of GAN. In order to increase the randomness of the generated samples, noises are obtained by a mixed strategy, that is, some noises of generator obey Gaussian distribution and others obey random distribution. Then G-GAN is trained to generate dispersive positive samples with the idea of Bagging, which could avoid the occurrence of overfitting. G-GAN is different from other literatures in that GAN does not directly generate minority samples, but adds the distribution information of minority samples to the latent space of GAN, and then generates minority samples. Compared with 11 commonly used oversampling methods, G-GAN obtains promising results in terms of G-mean, AUC, F-measure and ROC utilizing three classifiers on 11 benchmark imbalanced datasets. Furthermore, G-GAN is also validated on AUC metrics of a real Diabetes imbalanced dataset. The results demonstrate that G-GAN can provide great potential for imbalanced classification in the two numerical experiments.

automation & control systems,computer science, artificial intelligence,instruments & instrumentation,statistics & probability,mathematics, interdisciplinary applications,chemistry, analytical

Programming Languages for Real-Time Applications Executing on Parallel Hardware

IDA-GAN: A Novel Imbalanced Data Augmentation GAN

CMAGAN: classifier-aided minority augmentation generative adversarial networks for industrial imbalanced data and its application to fault prediction

Data Augmentation Classifier for Imbalanced Fault Classification

Collaborative Discrimination-Enabled Generative Adversarial Network (CoD-GAN) for the Data Augmentation in Imbalanced Classification

IB-GAN: A Unified Approach for Multivariate Time Series Classification under Class Imbalance

Ensemble Data Augmentation for Imbalanced Fault Diagnosis.

Enhancing and improving the performance of imbalanced class data using novel GBO and SSG: A comparative analysis

Distribution Enhancement for Imbalanced Data with Generative Adversarial Network

BAGAN: Data Augmentation with Balancing GAN

GAN based Data Augmentation to Resolve Class Imbalance

SGBGAN: minority class image generation for class-imbalanced datasets

Multi-class imbalanced image classification using conditioned GANs

A tutorial on generative adversarial networks with application to classification of imbalanced data

Deep Learning for Imbalance Data Classification using Class Expert Generative Adversarial Network

An intra-class distribution-focused generative adversarial network approach for imbalanced tabular data learning

RGAN-EL: A GAN and ensemble learning-based hybrid approach for imbalanced data classification

Efficient Generative Adversarial Networks for Imbalanced Traffic Collision Datasets

DGM: a data generative model to improve minority class presence in anomaly detection domain

Using Bidirectional GAN with Improved Training Architecture for Imbalanced Tasks

An ensemble oversampling method for imbalanced classification with prior knowledge via generative adversarial network