Abstract:Extreme learning machine (ELM) has demonstrated great potential in machine learning owing to its simplicity, rapidity and good generalization performance. In this investigation, based on least-squares estimate (LSE) and least absolute deviation (LAD), we propose four sparse ELM formulations with zero-norm regularization to automatically choose the optimal hidden nodes. Furthermore, we develop two continuous optimization methods to solve the proposed problems respectively. The first is DC (difference of convex functions) approximation approach that approximates the zero-norm by a DC function, and the resulting optimizations are posed as DC programs. The second is an exact penalty technique for zero-norm, and the resulting problems are reformulated as DC programs, and the corresponding DCAs converge finitely. Moreover, the proposed framework is applied directly to recognize the hardness of licorice seeds using near-infrared spectral data. Experiments in different spectral regions illustrate that the proposed approaches can reduce the number of hidden nodes (or output features), while either improve or show no significant difference in generalization compared with the traditional ELM methods and support vector machine (SVM). Experiments on several benchmark data sets demonstrate that the proposed framework is competitive with the traditional approaches in generalization, but selects fewer output features. A sparse ELM framework is proposed based on with zero-norm regularization.Four sparse ELM formulations with zero-norm are built based on LSE and LAD.We develop two continuous approaches to solve the problems.The first is DC (difference of convex functions) approximation approach.The second is an exact penalty technique for zero-norm.All the resulting problems are posed as DC programming.

Zero-Norm ELM with Non-convex Quadratic Loss Function for Sparse and Robust Regression

Robust Extreme Learning Machine with Exponential Squared Loss Via DC Programming

Robust regularized extreme learning machine for regression with non-convex loss function via DC program

L1-Norm Robust Regularized Extreme Learning Machine with Asymmetric C-Loss for Regression.

A sparse extreme learning machine framework by continuous optimization algorithms and its application in pattern recognition.

Outlier-robust extreme learning machine for regression problems

The constrained optimization extreme learning machine based on the hybrid loss function for regression

Robust Extreme Learning Machines with Different Loss Functions

A Robust Extreme Learning Machine Based on Adaptive Loss Function for Regression Modeling

Design of Extreme Learning Machine with Smoothed ℓ 0 Regularization

Elastic-net Based Robust Extreme Learning Machine for One-Class Classification.

Robust Extreme Learning Machine in the Presence of Outliers by Iterative Reweighted Algorithm

An optimization method of extreme learning machine for regression.

A Robust Multilayer Extreme Learning Machine Using Kernel Risk-Sensitive Loss Criterion

Robust Matching Pursuit Extreme Learning Machines

Joint Sparse Regularization Based Sparse Semi-Supervised Extreme Learning Machine (S3ELM) for Classification

A Novel Sparse Extreme Learning Machine based Classifier

Robust extreme learning machine for modeling with unknown noise

Regression and Classification Using Extreme Learning Machine Based on L-1-Norm and L-2-Norm

A Multiobjective Optimization-Based Sparse Extreme Learning Machine Algorithm

OMP-ELM: Orthogonal Matching Pursuit-Based Extreme Learning Machine for Regression