Abstract:The purpose of this study is to examine existing deep learning techniques for addressing class imbalanced data. Effective classification with imbalanced data is an important area of research, as high class imbalance is naturally inherent in many real-world applications, e.g., fraud detection and cancer detection. Moreover, highly imbalanced data poses added difficulty, as most learners will exhibit bias towards the majority class, and in extreme cases, may ignore the minority class altogether. Class imbalance has been studied thoroughly over the last two decades using traditional machine learning models, i.e. non-deep learning. Despite recent advances in deep learning, along with its increasing popularity, very little empirical work in the area of deep learning with class imbalance exists. Having achieved record-breaking performance results in several complex domains, investigating the use of deep neural networks for problems containing high levels of class imbalance is of great interest. Available studies regarding class imbalance and deep learning are surveyed in order to better understand the efficacy of deep learning when applied to class imbalanced data. This survey discusses the implementation details and experimental results for each study, and offers additional insight into their strengths and weaknesses. Several areas of focus include: data complexity, architectures tested, performance interpretation, ease of use, big data application, and generalization to other domains. We have found that research in this area is very limited, that most existing work focuses on computer vision tasks with convolutional neural networks, and that the effects of big data are rarely considered. Several traditional methods for class imbalance, e.g. data sampling and cost-sensitive learning, prove to be applicable in deep learning, while more advanced methods that exploit neural network feature learning abilities show promising results. The survey concludes with a discussion that highlights various gaps in deep learning from class imbalanced data for the purpose of guiding future research.

A literature survey on various aspect of class imbalance problem in data mining

Class Imbalance Problem in Data Mining Review

A Survey of Methods for Managing the Classification and Solution of Data Imbalance Problem

A survey on imbalanced learning: latest research, applications and future directions

A broad review on class imbalance learning techniques

Class overlap handling methods in imbalanced domain: A comprehensive survey

Survey on deep learning with class imbalance

A literature review on one-class classification and its potential applications in big data

A Survey of Deep Long-Tail Classification Advancements

Hybrid approaches for handling imbalanced structured and unstructured data

A survey on learning from imbalanced data streams: taxonomy, challenges, empirical study, and reproducible experimental framework

Imbalanced Data Classification:A Survey and Experiments in Medical Domain

Handling Imbalanced Data: A Case Study for Binary Class Problems

A Survey of Methods for Addressing Class Imbalance in Deep-Learning Based Natural Language Processing

A systematic review for class-imbalance in semi-supervised learning

Transfer learning for class imbalance problems with inadequate data

Class Imbalance Problem: A Wrapper-Based Approach using Under-Sampling with Ensemble Learning

Rethinking Class Imbalance in Machine Learning

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Review of Classification Methods on Unbalanced Data Sets

A Survey of Methods for Handling Disk Data Imbalance