Abstract:As a special deep learning algorithm, the multilayer extreme learning machine (ML-ELM) has been extensively studied to solve practical problems in recent years. The ML-ELM is constructed from the extreme learning machine autoencoder (ELM-AE), and its generalization performance is affected by the representation learning of the ELM-AE. However, given label information, the unsupervised learning of the ELM-AE is difficult to build the discriminative feature space for classification tasks. To address this problem, a novel Fisher extreme learning machine autoencoder (FELM-AE) is proposed and is used as the component for the multilayer Fisher extreme leaning machine (ML-FELM). The FELM-AE introduces the Fisher criterion into the ELM-AE by adding the Fisher regularization term to the objective function, aiming to maximize the between-class distance and minimize the within-class distance of abstract feature. Different from the ELM-AE, the FELM-AE requires class labels to calculate the Fisher regularization loss, so that the learned abstract feature contains sufficient category information to complete classification tasks. The ML-FELM stacks the FELM-AE to extract feature and adopts the extreme leaning machine (ELM) to classify samples. Experiments on benchmark datasets show that the abstract feature extracted by the FELM-AE is more discriminative than the ELM-AE, and the classification results of the ML-FELM are more competitive and robust in comparison with the ELM, one-dimensional convolutional neural network (1D-CNN), ML-ELM, denoising multilayer extreme learning machine (D-ML-ELM), multilayer generalized extreme learning machine (ML-GELM), and hierarchical extreme learning machine with L21‑norm loss and regularization (H-LR21-ELM).

Multilayer one-class extreme learning machine.

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Extreme Learning Machine with Multiple Kernels

Multi-Kernel Transfer Extreme Learning Classification

Genetic Ensemble of Extreme Learning Machine

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

Multi-class AdaBoost ELM

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Multilayer Fisher Extreme Learning Machine for Classification

Multilayer discriminative extreme learning machine for classification

Optimization-Based Extreme Learning Machine with Multi-kernel Learning Approach for Classification

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

Laplacian Multi Layer Extreme Learning Machine

Extreme Learning Machine Based Transfer Learning for Data Classification.

Extreme Learning Machine for Regression and Multiclass Classification

Denoising Laplacian Multi-Layer Extreme Learning Machine.

Multi Layer ELM-RBF for Multi-Label Learning

Monotonic classification extreme learning machine.

Extreme Learning Machine with Kernel Model Based on Deep Learning

Maximum Correntropy Criterion-Based Hierarchical One-Class Classification

Advancing the incremental fusion of robotic sensory features using online multi-kernel extreme learning machine