Abstract:As a single hidden layer feed-forward neural network, the extreme learning machine (ELM) has been extensively studied for its short training time and good generalization ability. Recently, with the deep learning algorithm becoming a research hotspot, some deep extreme learning machine algorithms such as multi-layer extreme learning machine (ML-ELM) and hierarchical extreme learning machine (H-ELM) have also been proposed. However, the deep ELM algorithm also has many shortcomings: (1) when the number of model layers is shallow, the random feature mapping makes the sample features cannot be fully learned and utilized; (2) when the number of model layers is deep, the validity of the sample features will decrease after continuous abstraction and generalization. In order to solve the above problems, this paper proposes a densely connected deep ELM algorithm: dense-HELM (D-HELM). Benchmark data sets of different sizes have been employed for the property of the D-HELM algorithm. Compared with the H-ELM algorithm on the benchmark dataset, the average test accuracy is increased by 5.34% and the average training time is decreased by 21.15%. On the NORB dataset, the proposed D-HELM algorithm still maintains the best classification results and the fastest training speed. The D-HELM algorithm can make full use of the features of hidden layer learning by using the densely connected network structure and effectively reduce the number of parameters. Compared with the H-ELM algorithm, the D-HELM algorithm significantly improves the recognition accuracy and accelerates the training speed of the algorithm.

A New Pruning Algorithm for Extreme Learning Machine

Extreme Learning Machine with Multiple Kernels

Genetic Ensemble of Extreme Learning Machine

A Fast Incremental Method Based on Regularized Extreme Learning Machine

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Class-Aware Pruning for Efficient Neural Networks

A Pruning Ensemble Model of Extreme Learning Machine with $$L_{1/2}$$L1/2 Regularizer

Hierarchical Pruning Discriminative Extreme Learning Machine

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

A Pruning Ensemble Model of Extreme Learning Machine with <Emphasis Type="Italic">L</Emphasis><Subscript>1/2</Subscript> Regularizer

Neuron Pruning-Based Discriminative Extreme Learning Machine for Pattern Classification

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Self-adaptive Extreme Learning Machine Optimized by Rough Set Theory and Affinity Propagation Clustering

Dynamic Adjustment of Hidden Node Parameters for Extreme Learning Machine

Densely Connected Deep Extreme Learning Machine Algorithm

An Extreme Learning Machine Based on Artificial Immune System.

A study on effectiveness of extreme learning machine

Dynamic Adjustment of Hidden Layer Structure for Convex Incremental Extreme Learning Machine

Extreme learning machine: algorithm, theory and applications

Extreme Learning Machine with Kernel Model Based on Deep Learning

Length-Changeable Incremental Extreme Learning Machine