Abstract:Extreme learning machine (ELM), as a newly developed learning paradigm for the generalized single hidden layer feedforward neural networks, has been widely studied due to its unique characteristics, i.e., fast training, good generalization, and universal approximation/classification ability. A novel framework of discriminative extreme learning machine (DELM) is developed for pattern classification. In DELM, the margins between different classes are enlarged as much as possible through a technique called ε-dragging. DELM is further extended to pruning DELM (P-DELM) using L2,1-norm regularization. The performance of DELM is compared with several state-of-the-art methods on public face databases. The simulation results show the effectiveness of DELM for face recognition when there are posture, facial expression, and illumination variations. P-DELM can distinguish the importance of different hidden neurons and remove the worthless ones. The model can achieve promising performance with fewer hidden neurons and less prediction time on several benchmark datasets. In DELM model, the margins between different classes are enlarged by learning a nonnegative label relaxation matrix. The experiments validate the effectiveness of DELM. Furthermore, DELM is extended to P-DELM based on L2,1-norm regularization. The developed P-DELM can naturally distinguish the importance of different hidden neurons, which will lead to a more compact network by neuron pruning. Experimental validations on some benchmark datasets show the advantages of the proposed P-DELM method.

A Generalized Pruning Algorithm for Extreme Learning Machine.

Genetic Ensemble of Extreme Learning Machine

Extreme Learning Machine with Multiple Kernels

A Fast Incremental Method Based on Regularized Extreme Learning Machine

A Pruning Ensemble Model of Extreme Learning Machine with $$L_{1/2}$$L1/2 Regularizer

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

A Pruning Ensemble Model of Extreme Learning Machine with <Emphasis Type="Italic">L</Emphasis><Subscript>1/2</Subscript> Regularizer

Hierarchical Pruning Discriminative Extreme Learning Machine

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

Dynamic Adjustment of Hidden Node Parameters for Extreme Learning Machine

Training an Extreme Learning Machine by Localized Generalization Error Model

Self-adaptive Extreme Learning Machine Optimized by Rough Set Theory and Affinity Propagation Clustering

A pruning algorithm with L 1/2 regularizer for extreme learning machine

Parsimonious Extreme Learning Machine Using Recursive Orthogonal Least Squares.

Universal Approximation of Extreme Learning Machine With Adaptive Growth of Hidden Nodes.

Generalized extreme learning machine autoencoder and a new deep neural network.

Extreme learning machine: Theory and applications

Neuron Pruning-Based Discriminative Extreme Learning Machine for Pattern Classification

A Kind of Parameters Self-adjusting Extreme Learning Machine

A Modified Fast Recursive Hidden Nodes Selection Algorithm For Elm