Abstract:The imbalanced data classification attracts increasing attention in the past years due to the continuous expansion of data available in many areas, such as biomedical engineering, surveillance, and computer vision. Learning from imbalanced data is challenging as most standard algorithms fail to properly represent the inherent complex characteristics of the data distribution. As an emerging technology, the extreme learning machine (ELM) and its variants, including the weighted ELM (WELM) and the boosting weighted ELM (BWELM), have been recently developed for the classification of imbalanced data. However, the WELM suffers the following deficiencies: (i) the sample weight matrix is manually chosen and fixed during the learning phase; (ii) the representation capability, namely the capability to extract features or useful information from the original data, is insufficiently explored due to its shallow structure. The BWELM employs the AdaBoost algorithm to optimize the sample weights. But the representation capability is still restricted by the shallow structure. To alleviate these deficiencies, we propose a novel deep weighted ELM (DWELM) algorithm for imbalanced data classification in this paper. An enhanced stacked multilayer deep representation network trained with the ELM (EH-DrELM) is first proposed to improve the representation capability, and a fast AdaBoost algorithm for imbalanced multiclass data (AdaBoost-ID) is developed to optimize the sample weights. Then, the novel DWELM for the imbalance learning is obtained by combining the above two algorithms. Experimental results on nine imbalanced binary-class datasets, nine imbalanced multiclass datasets, and five large benchmark datasets (three for multiclass and two for binary-class) show that the proposed DWELM achieves a better performance than the WELM and BWELM, as well as several state-of-the-art multilayer network-based learning algorithms.

Kernel Based Online Learning for Imbalance Multiclass Classification.

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Optimal Weighted Extreme Learning Machine for Imbalanced Learning with Differential Evolution [research Frontier]

A Novel SMOTE-Based Classification Approach to Online Data Imbalance Problem

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

A Local Online Learning Approach for Non-linear Data.

Two-Stage Weighted Regularized Extreme Learning Machine for Class Imbalanced Learning

Active learning with extreme learning machine for online imbalanced multiclass classification

Active Learning From Imbalanced Data: A Solution of Online Weighted Extreme Learning Machine.

Enhanced Kernel-Based Multilayer Fuzzy Weighted Extreme Learning Machines

A Kernel Clustering-Based Possibilistic Fuzzy Extreme Learning Machine for Class Imbalance Learning

Variances-constrained weighted extreme learning machine for imbalanced classification

Parallel One-Class Extreme Learning Machine for Imbalance Learning Based on Bayesian Approach.

A Self-Adaptive Evolutionary Weighted Extreme Learning Machine for Binary Imbalance Learning

A Heterogeneous AdaBoost Ensemble Based Extreme Learning Machines for Imbalanced Data

Class-specific Cost Regulation Extreme Learning Machine for Imbalanced Classification

BEDCOE: Borderline Enhanced Disjunct Cluster Based Oversampling Ensemble for Online Multi-class Imbalance Learning

An Algorithm of Robust Online Extreme Learning Machine for Dynamic Imbalanced Datasets

Double-kernel Based Class-Specific Broad Learning System for Multiclass Imbalance Learning

LW-ELM: A Fast and Flexible Cost-Sensitive Learning Framework for Classifying Imbalanced Data.

Deep Weighted Extreme Learning Machine