Abstract:As data sets become larger and more complicated, an extreme learning machine (ELM) that runs in a traditional serial environment cannot realize its ability to be fast and effective. Although a parallel ELM (PELM) based on MapReduce to process large-scale data shows more efficient learning speed than identical ELM algorithms in a serial environment, some operations, such as intermediate results stored on disks and multiple copies for each task, are indispensable, and these operations create a large amount of extra overhead and degrade the learning speed and efficiency of the PELMs. In this paper, an efficient ELM based on the Spark framework (SELM), which includes three parallel subalgorithms, is proposed for big data classification. By partitioning the corresponding data sets reasonably, the hidden layer output matrix calculation algorithm, matrix decomposition algorithm, and matrix decomposition algorithm perform most of the computations locally. At the same time, they retain the intermediate results in distributed memory and cache the diagonal matrix as broadcast variables instead of several copies for each task to reduce a large amount of the costs, and these actions strengthen the learning ability of the SELM. Finally, we implement our SELM algorithm to classify large data sets. Extensive experiments have been conducted to validate the effectiveness of the proposed algorithms. As shown, our SELM achieves an speedup on a cluster with ten nodes, and reaches a speedup with 15 nodes, an speedup with 20 nodes, a speedup with 25 nodes, a speedup with 30 nodes, and a speedup with 35 nodes.

Extreme Learning Machine for Large-Scale Graph Classification Based on MapReduce

Genetic Ensemble of Extreme Learning Machine

Extreme Learning Machine Based Transfer Learning for Data Classification.

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Big Graph Classification Frameworks Based on Extreme Learning Machine.

MR-ELM: a MapReduce-based framework for large-scale ELM training in big data era

Large-Scale Graph Classification Based On Evolutionary Computation With Mapreduce

ELM-MapReduce: MapReduce Accelerated Extreme Learning Machine for Big Spatial Data Analysis

Parallel Multi-Graph Classification Using Extreme Learning Machine and MapReduce

Elastic Extreme Learning Machine For Big Data Classification

ELM ∗ : distributed extreme learning machine with MapReduce

A Parallel Multiclassification Algorithm for Big Data Using an Extreme Learning Machine

A-ELM: Adaptive Distributed Extreme Learning Machine with MapReduce.

Parallel extreme learning machine for regression based on MapReduce

Graph Convolutional Extreme Learning Machine

An Integration of Extreme Learning Machine for Classification of Big Data

A-elm*

On extending extreme learning machine to non-redundant synergy pattern based graph classification.

Distributed Extreme Learning Machine for Nonlinear Learning over Network

Uncertain Graph Classification Based on Extreme Learning Machine.

A Fast Training Algorithm for Extreme Learning Machine Based on Matrix Decomposition.