Abstract:In general, it is a worth challenging problem to build a robust classifier for data sets with noises or outliers. Establishing a robust classifier is a more difficult problem for datasets with asymmetric noise distribution. The Fisher-regularized extreme learning machine (Fisher-ELM) considers the statistical knowledge of the data, however, it ignores the impact of noises or outliers. In this paper, to reduce the negative influence of noises or outliers, we first put forward a novel asymmetric Welsch loss function named AW-loss based on asymmetric -loss function and Welsch loss function. Based on the AW-loss function, we then present a new robust Fisher-ELM called AWFisher-ELM. The proposed AWFisher-ELM not only takes into account the statistical information of the data, but also considers the impact of asymmetric distribution noises. We utilize concave-convex procedure (CCCP) and dual method to solve the non-convexity of the proposed AWFisher-ELM. Simultaneously, an algorithm for AWFisher-ELM is given and a theorem about the convergence of the algorithm is proved. To validate the effectiveness of our algorithm, we compare our AWFisher-ELM with the other state-of-the-art methods on artificial data sets, UCI data sets, NDC large data sets and image data sets by setting different ratios of noises. The experimental results are as follows, the accuracy of AWFisher-ELM is the highest in the artificial data sets, reaching 98.9%. For the large-scale NDC data sets and the image data sets, the accuracy of AWFisher-ELM is also the highest. For the ten UCI data sets, the accuracy and value of AWFisher-ELM are the highest in most data sets expect for Diabetes. In terms of training time, our AWFisher-ELM has almost the same training time with RHELM and CHELM, but it takes longer time than OPT-ELM, WCS-SVM, Fisher-SVM, Pinball-FisherSVM, and Fisher-ELM. This is because AWFisher-ELM, RHELM, and CHELM need to solve a convex quadratic subprogramming problem in each iteration. In conclusion, our method exhibits excellent generalization performance expect for the longer training time.

Preliminary Study on Wilcoxon-Norm-Based Robust Extreme Learning Machine

A Novel Robust Smooth Support Vector Machine

Genetic Ensemble of Extreme Learning Machine

Optimal Weighted Extreme Learning Machine for Imbalanced Learning with Differential Evolution [research Frontier]

Nonlinear Robust Modeling Base on Least Trimmed Squares Regression

L1-Norm Robust Regularized Extreme Learning Machine with Asymmetric C-Loss for Regression.

A Robust Extreme Learning Machine Based on Adaptive Loss Function for Regression Modeling

A Rough RBF Neural Network Based on Weighted Regularized Extreme Learning Machine

Zero-Norm ELM with Non-convex Quadratic Loss Function for Sparse and Robust Regression

Robust Multi-Layer Extreme Learning Machine Using Bias-Variance Tradeoff

Robust penalized extreme learning machine regression with applications in wind speed forecasting

Research on Extreme Learning of Neural Networks

Distributed Extreme Learning Machine for Nonlinear Learning over Network

Robust Matching Pursuit Extreme Learning Machines

Nonlinear Monte Carlo Method for Imbalanced Data Learning

A robust double-parallel extreme learning machine based on an improved M-estimation algorithm

Robust Fisher-regularized extreme learning machine with asymmetric Welsch-induced loss function for classification

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

The Robust Supervised Learning Framework: Harmonious Integration of Twin Extreme Learning Machine, Squared Fractional Loss, Capped L2,p-norm Metric, and Fisher Regularization

Robust noise-aware algorithm for randomized neural network and its convergence properties

Evolutionary Selection Extreme Learning Machine Optimization for Regression.