Abstract:The classification problem is a key area of research in machine learning. The Least Squares Support Vector Machine (LSSVM) is an important classifier that is commonly used to solve classification problems. Its widespread use stems from its replacement of the inequality constraint in the Support Vector Machine (SVM) with the equality constraint, which transforms the convex quadratic programming (QP) problem of SVM into the solution of linear equations. However, when dealing with multi-class classification problems, LSSVM faces the challenges of lack of sparsity and sample noises, which can negatively impact its performance. Based on the modeling characteristics and data distribution of the multi-class LSSVM model, this paper proposes two improvements and establishes an improved fuzzy sparse multi-class least squares support vector machine (IF-S-M-LSSVM). The first improvement adopts a non-iterative sparse algorithm, which can delete training sample points to different degrees by adjusting the sparse ratio. The second improvement addresses the impact of sample noise on determining the optimal hyperplane by adding a fuzzy membership degree based on sample density. The advantages of the new model, in terms of training speed and classification accuracy, are verified through UCI machine learning standard data set experiments. Finally, the statistical significance of the IF-S-M-LSSVM model is tested using the Friedman and Bonferroni-Dunn tests.

Sparse Learning for Support Vector Classification

Sparse Representation Based on Projection Method in Online Least Squares Support Vector Machines

An On-Line Learning Approach with Support Vector Dormain Classifier

Sparse Least Squares Support Vector Machine for Function Estimation

One Kind of Reduced Learning Algorithm for Support Vector Domain Description

Improved Sparse Least-Squares Support Vector Machine Classifiers.

Modeling method of least squares support vector regression based on vector base learning

Efficient Sparse Least Squares Support Vector Machines for Regression

Online Kernel Learning with a Near Optimal Sparsity Bound

DCA for Sparse Quadratic Kernel-Free Least Squares Semi-Supervised Support Vector Machine

Sparse Least Absolute Deviation Support Vector Machine

Improved fuzzy sparse multi-class least squares support vector machine

Sparse Universum Quadratic Surface Support Vector Machine Models for Binary Classification

Minimal Support Vector Machine

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Scaling Up Sparse Support Vector Machines by Simultaneous Feature and Sample Reduction

A Non-Biased Form of Least Squares Support Vector Classifier and Its Fast Online Learning

A two stages sparse SVM training

Improved Sparse LSSVMS Based on the Localized Generalization Error Model

Novel sparse Support Vector Regression and its experimental study

A Pruning Strategy Based On Confidence Interval For Sparse Ls-Svm