Abstract:In a two-class classification task, if the number of examples of one class (majority) is much greater than that of another class (minority), then the classification is said to be class imbalanced. It can occur among many real-world applications, such as intrusion detection, medical diagnosis, etc. The class imbalance issue can make learning difficult since learning opts to bias towards the majority class. Outliers are cases with anomalous behaviors and are extreme cases of class imbalance. Despite late advances in extreme learning machines (ELMs), there are not many experimental investigations in the field of ELM with outlier detection. In this survey, we provide a comprehensive overview of existing ELMs to address the problem of outlier detection under a unified perspective. Firstly, we describe the background of our work, which includes a brief overview of previous surveys and a detailed description of the enhanced ELMs. Next, available studies regarding why ELMs are used to tackle the class imbalance problem are reviewed. Furthermore, cutting-edge algorithms are surveyed for improved ELMs to detect outliers. We classify these methods under three different machine learning perspectives (i.e., supervised, unsupervised, and semi-supervised approaches). In addition, we explore the developments of existing solutions based on three standardized quality metrics (i.e., accuracy, robustness, and speed) and other performance metrics (e.g., mean absolute percentage error and mean absolute error). After that, related datasets are detailed to facilitate future studies in this field. Last but the most important, this study concludes with discussions, challenges, and suggestions to guide future research.

Robust Extreme Learning Machine in the Presence of Outliers by Iterative Reweighted Algorithm

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Robust regularized extreme learning machine for regression with non-convex loss function via DC program

Optimal Weighted Extreme Learning Machine for Imbalanced Learning with Differential Evolution [research Frontier]

A Robust Extreme Learning Machine Based on Adaptive Loss Function for Regression Modeling

Robust Extreme Learning Machine with Exponential Squared Loss Via DC Programming

Robust Multi-Layer Extreme Learning Machine Using Bias-Variance Tradeoff

Elastic-net Based Robust Extreme Learning Machine for One-Class Classification.

Robust Semi-Supervised Extreme Learning Machine

A robust double-parallel extreme learning machine based on an improved M-estimation algorithm

L1-Norm Robust Regularized Extreme Learning Machine with Asymmetric C-Loss for Regression.

Robust Extreme Learning Machines with Different Loss Functions

Survey on extreme learning machines for outlier detection

Robust Matching Pursuit Extreme Learning Machines

Incremental regularized extreme learning machine and it's enhancement.

Zero-Norm ELM with Non-convex Quadratic Loss Function for Sparse and Robust Regression

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Fast and Unsupervised Outlier Removal by Recurrent Adaptive Reconstruction Extreme Learning Machine

RMSE-ELM: Recursive Model Based Selective Ensemble of Extreme Learning Machines for Robustness Improvement

A new robust ELM method based on a Bayesian framework with heavy-tailed distribution and weighted likelihood function.

An optimization method of extreme learning machine for regression.