Abstract:Extreme Learning Machine (ELM) and its variants have been widely used for many applications due to its fast convergence and good generalization performance. Though the distributed ELM* based on MapReduce framework can handle very large scale training dataset in big data applications, how to cope with its rapidly updating is still a challenging task. Therefore, in this paper, a novel Elastic Extreme Learning Machine based on MapReduce framework, named Elastic ELM ((ELM)-L-2), is proposed to cover the shortage of ELM* whose learning ability is weak to the updated large-scale training dataset. Firstly, after analyzing the property of ELM* adequately, it can be found out that its most computation-expensive part, matrix multiplication, can be incrementally, decrementally and correctionally calculated. Next, the Elastic ELM based on MapReduce framework is developed, which first calculates the intermediate matrix multiplications of the updated training data subset, and then update the matrix multiplications by modifying the old matrix multiplications with the intermediate ones. Then, the corresponding new output weight vector can be obtained with centralized computing using the update the matrix multiplications. Therefore, the efficient learning of rapidly updated massive training dataset can be realized effectively. Finally, we conduct extensive experiments on synthetic data to verify the effectiveness and efficiency of our proposed (ELM)-L-2 in learning massive rapidly updated training dataset with various experimental settings. (C) 2014 Elsevier B.V. All rights reserved.

An experimental evaluation of extreme learning machines on several hardware devices

Benchmarking Hardware Accelerating Techniques for Extreme Learning Machine.

Extreme Learning Machine with Multiple Kernels

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

System-on-a-Chip (SoC)-Based Hardware Acceleration for an Online Sequential Extreme Learning Machine (OS-ELM)

Trends in extreme learning machines

Elastic Extreme Learning Machine For Big Data Classification

A generic FPGA-based hardware architecture for recursive least mean p-power extreme learning machine

Extreme learning machine: Theory and applications

Fixed-Point Evaluation of Extreme Learning Machine for Classification

A Fast Training Algorithm for Extreme Learning Machine Based on Matrix Decomposition.

A study on effectiveness of extreme learning machine

GPU-Accelerated Parallel Hierarchical Extreme Learning Machine on Flink for Big Data

ELM ∗ : distributed extreme learning machine with MapReduce

Trends in Extreme Learning Machines: A Review

An Extreme Learning Machine Based on Artificial Immune System.

A review on extreme learning machine

Extreme learning machine: algorithm, theory and applications

Multi-class AdaBoost ELM

An Experimental Study on Deep Learning Based on Different Hardware Configurations