Abstract:In this work we propose a minimax probability extreme learning machine framework (MPME), which combines the benefits of minimax probability machine (MPM) with extreme learning machine (ELM). For binary classification problems, we illustrate that the proposed MPME can be interpreted geometrically by minimizing the maximum of Mahalanobis distances to the two classes. Then two variants of the MPME are presented based on the l2-norm loss and l1-norm loss functions (called LSEMPME and LADMPME) respectively. Without making specific assumption on the data distribution, the proposed methods can provide explicit upper-bounds for the generalization error, moreover the LSEMPME and LADMPME minimize empirical risk simultaneously. The decision hyperplanes of the proposed methods pass through the origin in ELM feature space with few decision variables. By using the multivariate Chebyshev–Cantelli inequality, all the proposed problems can be reformulated as second-order cone programming (SOCP) with global solutions. Furthermore, numerical experiments have been carried out on two databases that are drawn from UCI benchmark database and a practical application database. First, the proposed methods are evaluated for a practical application consisting on the analysis of licorice seeds using near-infrared spectral (NIR) data. Experiments in six different spectral regions illustrate that the proposed methods can improve generalization in most cases. Then the proposed methods are evaluated on benchmark datasets. In comparison with traditional methods including MPM, ELM and support vector machine (SVM), experiments show that the proposed methods achieve comparable results in generalization. With few decision variables, the proposed methods are easy to implement for nonlinear classification and to estimate a lower-bound on the prediction accuracy.

A Minimax Probability Extreme Machine Framework and Its Application in Pattern Recognition

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Extreme Learning Machine with Multiple Kernels

Genetic Ensemble of Extreme Learning Machine

A sparse extreme learning machine framework by continuous optimization algorithms and its application in pattern recognition.

A New Minimax Probabilistic Approach and Its Application in Recognition the Purity of Hybrid Seeds

Generalized eigenvalue extreme learning machine for classification

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Structural Minimax Probability Machine

Simultaneous Feature Selection and Classification Via Minimax Probability Machine.

Transductive Minimax Probability Machine.

A Robust Extreme Learning Machine Framework for Uncertain Data Classification

Lagrangian supervised and semi-supervised extreme learning machine

Extreme Learning Machine under Minimum Information Divergence Criterion

A Minimax Probability Machine for Non-Decomposable Performance Measures.

Extreme Learning Machine for Regression and Multiclass Classification

Imbalanced Extreme Learning Machine for Classification with Imbalanced Data Distributions

Mixture Correntropy-Based Kernel Extreme Learning Machines

Optimization-Based Extreme Learning Machine with Multi-kernel Learning Approach for Classification

Kernel-Free Quadratic Surface Minimax Probability Machine for a Binary Classification Problem

A Performance Bound of the Multi-Output Extreme Learning Machine Classifier