Abstract:The classification problem is a key area of research in machine learning. The Least Squares Support Vector Machine (LSSVM) is an important classifier that is commonly used to solve classification problems. Its widespread use stems from its replacement of the inequality constraint in the Support Vector Machine (SVM) with the equality constraint, which transforms the convex quadratic programming (QP) problem of SVM into the solution of linear equations. However, when dealing with multi-class classification problems, LSSVM faces the challenges of lack of sparsity and sample noises, which can negatively impact its performance. Based on the modeling characteristics and data distribution of the multi-class LSSVM model, this paper proposes two improvements and establishes an improved fuzzy sparse multi-class least squares support vector machine (IF-S-M-LSSVM). The first improvement adopts a non-iterative sparse algorithm, which can delete training sample points to different degrees by adjusting the sparse ratio. The second improvement addresses the impact of sample noise on determining the optimal hyperplane by adding a fuzzy membership degree based on sample density. The advantages of the new model, in terms of training speed and classification accuracy, are verified through UCI machine learning standard data set experiments. Finally, the statistical significance of the IF-S-M-LSSVM model is tested using the Friedman and Bonferroni-Dunn tests.

The application of least squares support vector machine for classification

Least Squares Support Vector Machines Based on Support Vector Degrees

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

Least squares support vector machine based partially linear model identification

Least Squares Support Vector Machine Algorithm

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Using Svm To Model And Control Nonlinear Dynamical Systems

Least Square Generalized Support Vector Machines for Regression

Least Square Support Vector Machine Analysis for the Classification of Paddy Seeds by Harvest Year

Dynamic least squares support vector machine

Relation Between a Support Vector Machine and the Least Square Method

Improved Weighted Least Squares Support Vector Machines Algorithm And Its Applications In Spectroscopic Quantitative Analysis

Asymmetric Least Squares Support Vector Machine Classifiers

A Fast Iterative Single Data Approach to Training Unconstrained Least Squares Support Vector Machines

Sparse Least Squares Support Vector Machine for Function Estimation

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

Improved fuzzy sparse multi-class least squares support vector machine

Modeling method of least squares support vector regression based on vector base learning

An unbiased LSSVM model for classification and regression

Sparse Least Absolute Deviation Support Vector Machine

Improved Conjugate Gradient Implementation for Least Squares Support Vector Machines