Abstract:The classification problem is a key area of research in machine learning. The Least Squares Support Vector Machine (LSSVM) is an important classifier that is commonly used to solve classification problems. Its widespread use stems from its replacement of the inequality constraint in the Support Vector Machine (SVM) with the equality constraint, which transforms the convex quadratic programming (QP) problem of SVM into the solution of linear equations. However, when dealing with multi-class classification problems, LSSVM faces the challenges of lack of sparsity and sample noises, which can negatively impact its performance. Based on the modeling characteristics and data distribution of the multi-class LSSVM model, this paper proposes two improvements and establishes an improved fuzzy sparse multi-class least squares support vector machine (IF-S-M-LSSVM). The first improvement adopts a non-iterative sparse algorithm, which can delete training sample points to different degrees by adjusting the sparse ratio. The second improvement addresses the impact of sample noise on determining the optimal hyperplane by adding a fuzzy membership degree based on sample density. The advantages of the new model, in terms of training speed and classification accuracy, are verified through UCI machine learning standard data set experiments. Finally, the statistical significance of the IF-S-M-LSSVM model is tested using the Friedman and Bonferroni-Dunn tests.

Method of Pattern Classification Based on FSVM and RS Theory

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

Association rules extraction based on support vector machines

A novel pattern recognition algorithm: Combining ART network with SVM to reconstruct a multi-class classifier

Fault Diagnosis Based on RS and SVM

An Interval Set Classification Based on Support Vector Machines

Associative Classifier Modeling Method Based On Rough Set Theory And Factor Analysis Technology

Multi-sphere Classification Algorithm Based on 1-SVM

Cost Sensitive Support Vector Machines

Multiclass Cancer Classification by Using Fuzzy Support Vector Machine and Binary Decision Tree with Gene Selection

Research and Analysis of Methods for Multiclass Support Vector Machines

Hierarchical 1-FSVM Algorithm Based on SMO

SVM-Based Cost-sensitive Classification Algorithm with Error Cost and Class-dependent Reject Cost

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Improved fuzzy sparse multi-class least squares support vector machine

Weighted Least Squares Twin Support Vector Machine with Fuzzy Rough Set Theory for Imbalanced Data Classification

A selection methods of feature attributes based on RS-SVM

Multi-class Support Vector Machine for Fault Diagnosis

Face Pose Discrimination with Support Vector Machines

Studies on the evaluation of college classroom teaching quality based on SVM multiclass classification algorithm

Hyperspectral Image Classification Based on Fuzzy Support Vector Machine