Abstract:Extreme Learning Machine (ELM) feature representation has been drawing increasing attention, and most of the previous works devoted to learning discriminative features. However, we argue that such kind of features suffer from “categories bias” in target detection tasks, where the scope of the negatives (i.e., backgrounds) is naturally broader than that of the positives (i.e., targets). Technically, the learning of discriminative features aims to maximize positive-negative difference. In this case, the interclass-difference criteria for feature mapping and feature matching would increase model complexity while degrading detection robustness. To address these issues, we construct a generative feature learning framework in this paper. Unlike the discriminative feature representation, generative features tend to cluster the positives from negatives, and in this way, the unique and separable attributes of the positives can be learnt to facilitate the accurate detection of positives (targets). Practically, by exploiting ELM computational advantages, positives clustering oriented feature learning is implemented with a kernel-label alignment function, which guides random features of positives into clusters, while keeping away from the negatives. On the other hand, the density of positives cluster is estimated using a probabilistic model, and thus the likelihood that test samples belonged to the positive category can be approximately inferred. We experimentally evaluate our framework for target detection on synthetic data and Hyperspectral Imagery (HSI), in which reasonable improvements are observed over conventional ELM-based discriminative methods and backpropagation-based multilayer perceptron (MLP) in terms of detection accuracy or learning efficiency.

Homogeneous Ensemble Extreme Learning Machine Autoencoder with Mutual Representation Learning and Manifold Regularization for Medical Datasets

Genetic Ensemble of Extreme Learning Machine

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

Hierarchical Ensemble of Extreme Learning Machine.

DeepHealth: Deep Representation Learning with Autoencoders for Healthcare Prediction

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Extreme Learning Machine with Multiple Kernels

Generalized extreme learning machine autoencoder and a new deep neural network.

Ensemble Learning via Extreme Learning Machines for Imbalanced Data

Laplacian Generalized Eigenvalues Extreme Learning Machine

Supervised Extreme Learning Machine-Based Auto-Encoder for Discriminative Feature Learning

Laplacian Multi Layer Extreme Learning Machine

Ensemble based extreme learning machine

GenELM: Generative Extreme Learning Machine Feature Representation

Multilayer discriminative extreme learning machine for classification

Improving Classification Performance Through an Advanced Ensemble Based Heterogeneous Extreme Learning Machines

Simple Ensemble of Extreme Learning Machine

Two-stage extreme learning machine for high-dimensional data

Globality-Locality Preserving Maximum Variance Extreme Learning Machine

Semi-supervised Multi-kernel Extreme Learning Machine.

A Hierarchical Structure of Extreme Learning Machine (HELM) for High-Dimensional Datasets with Noise