Abstract:The imbalanced data classification attracts increasing attention in the past years due to the continuous expansion of data available in many areas, such as biomedical engineering, surveillance, and computer vision. Learning from imbalanced data is challenging as most standard algorithms fail to properly represent the inherent complex characteristics of the data distribution. As an emerging technology, the extreme learning machine (ELM) and its variants, including the weighted ELM (WELM) and the boosting weighted ELM (BWELM), have been recently developed for the classification of imbalanced data. However, the WELM suffers the following deficiencies: (i) the sample weight matrix is manually chosen and fixed during the learning phase; (ii) the representation capability, namely the capability to extract features or useful information from the original data, is insufficiently explored due to its shallow structure. The BWELM employs the AdaBoost algorithm to optimize the sample weights. But the representation capability is still restricted by the shallow structure. To alleviate these deficiencies, we propose a novel deep weighted ELM (DWELM) algorithm for imbalanced data classification in this paper. An enhanced stacked multilayer deep representation network trained with the ELM (EH-DrELM) is first proposed to improve the representation capability, and a fast AdaBoost algorithm for imbalanced multiclass data (AdaBoost-ID) is developed to optimize the sample weights. Then, the novel DWELM for the imbalance learning is obtained by combining the above two algorithms. Experimental results on nine imbalanced binary-class datasets, nine imbalanced multiclass datasets, and five large benchmark datasets (three for multiclass and two for binary-class) show that the proposed DWELM achieves a better performance than the WELM and BWELM, as well as several state-of-the-art multilayer network-based learning algorithms.

Hyperspectral Image Classification by AdaBoost Weighted Composite Kernel Extreme Learning Machines

Multi-class AdaBoost ELM

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

${{\Rm E}^{2}}{\rm LMs}$ : Ensemble Extreme Learning Machines for Hyperspectral Image Classification

Dual-Weighted Kernel Extreme Learning Machine for Hyperspectral Imagery Classification

Optimal Weighted Extreme Learning Machine for Imbalanced Learning with Differential Evolution [research Frontier]

Kernel Extreme Learning Machine Joint Spatial-spectral Information for Hyperspectral Image Classification

Spectral-Spatial Classification of Hyperspectral Image Based on Kernel Extreme Learning Machine

A Spectral-Spatial Domain-Specific Convolutional Deep Extreme Learning Machine for Supervised Hyperspectral Image Classification.

Kernel Extreme Learning Machine Optimized by the Sparrow Search Algorithm for Hyperspectral Image Classification

Deep Weighted Extreme Learning Machine

Supervised Classification of Hyperspectral Images Using Local-Receptive-fields-based Kernel Extreme Learning Machine.

Hyperspectral Remote Sensing Image Classification with Information Discriminative Extreme Learning Machine

Densely connected convolutional extreme learning machine for hyperspectral image classification

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Variances-constrained weighted extreme learning machine for imbalanced classification

CMAAC: Combining Multiattention and Asymmetric Convolution Global Learning Framework for Hyperspectral Image Classification

Hyperspectral image classification using ensemble extreme learning machine based on fuzzy entropy weights and auto-adapted spatial-spectral features

A Wavelet Extreme Learning Machine