Abstract:Big dimensional data is a growing trend that is emerging in many real world contexts, extending from web mining, gene expression analysis, protein–protein interaction to high-frequency financial data. Nowadays, there is a growing consensus that the increasing dimensionality poses impeding effects on the performances of classifiers, which is termed as the “peaking phenomenon” in the field of machine intelligence. To address the issue, dimensionality reduction is commonly employed as a preprocessing step on the Big dimensional data before building the classifiers. In this paper, we propose an Extreme Learning Machine (ELM) approach for large-scale data analytic. In contrast to existing approaches, we embed hidden nodes that are designed using singular value decomposition (SVD) into the classical ELM. These SVD nodes in the hidden layer are shown to capture the underlying characteristics of the Big dimensional data well, exhibiting excellent generalization performances. The drawback of using SVD on the entire dataset, however, is the high computational complexity involved. To address this, a fast divide and conquer approximation scheme is introduced to maintain computational tractability on high volume data. The resultant algorithm proposed is labeled here as Fast Singular Value Decomposition-Hidden-nodes based Extreme Learning Machine or FSVD-H-ELM in short. In FSVD-H-ELM, instead of identifying the SVD hidden nodes directly from the entire dataset, SVD hidden nodes are derived from multiple random subsets of data sampled from the original dataset. Comprehensive experiments and comparisons are conducted to assess the FSVD-H-ELM against other state-of-the-art algorithms. The results obtained demonstrated the superior generalization performance and efficiency of the FSVD-H-ELM.

Extreme Learning Machine Ensemble Classifier for Large-Scale Data

Genetic Ensemble of Extreme Learning Machine

Extreme Learning Machine Based Transfer Learning for Data Classification.

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Multi-class AdaBoost ELM

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

An Integration of Extreme Learning Machine for Classification of Big Data

MR-ELM: a MapReduce-based framework for large-scale ELM training in big data era

A Parallel Multiclassification Algorithm for Big Data Using an Extreme Learning Machine

Classification with Extreme Learning Machine and Ensemble Algorithms Over Randomly Partitioned Data

ELM-MapReduce: MapReduce Accelerated Extreme Learning Machine for Big Spatial Data Analysis

An Extreme Learning Machine Based on Artificial Immune System.

A Fast SVD-Hidden-nodes Based Extreme Learning Machine for Large-Scale Data Analytics.

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

A Deep and Stable Extreme Learning Approach for Classification and Regression

Differential Evolution Based Selective Ensemble Of Extreme Learning Machine

Evolutionary extreme learning machine ensembles with size control

Parallelized extreme learning machine ensemble based on min-max modular network

A Fast Training Algorithm for Extreme Learning Machine Based on Matrix Decomposition.