Abstract:As a special deep learning algorithm, the multilayer extreme learning machine (ML-ELM) has been extensively studied to solve practical problems in recent years. The ML-ELM is constructed from the extreme learning machine autoencoder (ELM-AE), and its generalization performance is affected by the representation learning of the ELM-AE. However, given label information, the unsupervised learning of the ELM-AE is difficult to build the discriminative feature space for classification tasks. To address this problem, a novel Fisher extreme learning machine autoencoder (FELM-AE) is proposed and is used as the component for the multilayer Fisher extreme leaning machine (ML-FELM). The FELM-AE introduces the Fisher criterion into the ELM-AE by adding the Fisher regularization term to the objective function, aiming to maximize the between-class distance and minimize the within-class distance of abstract feature. Different from the ELM-AE, the FELM-AE requires class labels to calculate the Fisher regularization loss, so that the learned abstract feature contains sufficient category information to complete classification tasks. The ML-FELM stacks the FELM-AE to extract feature and adopts the extreme leaning machine (ELM) to classify samples. Experiments on benchmark datasets show that the abstract feature extracted by the FELM-AE is more discriminative than the ELM-AE, and the classification results of the ML-FELM are more competitive and robust in comparison with the ELM, one-dimensional convolutional neural network (1D-CNN), ML-ELM, denoising multilayer extreme learning machine (D-ML-ELM), multilayer generalized extreme learning machine (ML-GELM), and hierarchical extreme learning machine with L21‑norm loss and regularization (H-LR21-ELM).

Discriminative Clustering Via Extreme Learning Machine.

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Extreme Learning Machine Based Transfer Learning for Data Classification.

Genetic Ensemble of Extreme Learning Machine

An unsupervised discriminative extreme learning machine and its applications to data clustering

Extreme Learning Machine with Multiple Kernels

An unsupervised discriminative extreme learning machine and its applications to data clustering.

A clustering method based on extreme learning machine.

Information discriminative extreme learning machine

KELMC: An Improved K-Means Clustering Method Using Extreme Learning Machine

Optimal Weighted Extreme Learning Machine for Imbalanced Learning with Differential Evolution [research Frontier]

Discriminative manifold extreme learning machine and applications to image and EEG signal classification.

Unsupervised Extreme Learning Machine with Representational Features

Extreme Maximum Margin Clustering

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Multilayer discriminative extreme learning machine for classification

Deep Discriminative Clustering Analysis

A Kernel Clustering-Based Possibilistic Fuzzy Extreme Learning Machine for Class Imbalance Learning

Semi-supervised and unsupervised extreme learning machines.

Laplacian Multi Layer Extreme Learning Machine

Multilayer Fisher Extreme Learning Machine for Classification