Abstract:The classification problem is a key area of research in machine learning. The Least Squares Support Vector Machine (LSSVM) is an important classifier that is commonly used to solve classification problems. Its widespread use stems from its replacement of the inequality constraint in the Support Vector Machine (SVM) with the equality constraint, which transforms the convex quadratic programming (QP) problem of SVM into the solution of linear equations. However, when dealing with multi-class classification problems, LSSVM faces the challenges of lack of sparsity and sample noises, which can negatively impact its performance. Based on the modeling characteristics and data distribution of the multi-class LSSVM model, this paper proposes two improvements and establishes an improved fuzzy sparse multi-class least squares support vector machine (IF-S-M-LSSVM). The first improvement adopts a non-iterative sparse algorithm, which can delete training sample points to different degrees by adjusting the sparse ratio. The second improvement addresses the impact of sample noise on determining the optimal hyperplane by adding a fuzzy membership degree based on sample density. The advantages of the new model, in terms of training speed and classification accuracy, are verified through UCI machine learning standard data set experiments. Finally, the statistical significance of the IF-S-M-LSSVM model is tested using the Friedman and Bonferroni-Dunn tests.

Improved Least Squares Support Vector Machine Based on Metric Learning

Distance Metric Learning Via Iterated Support Vector Machines

A metric learning perspective of SVM: on the relation of SVM and LMNN

Iterated Support Vector Machines for Distance Metric Learning

A Metric-learning based framework for Support Vector Machines and Multiple Kernel Learning

Distance Metric Learning for Kernel Machines

Learning Distance Metric for Support Vector Machine: A Multiple Kernel Learning Approach.

Metric Learning Via Penalized Optimization.

Multi-Level Metric Learning Via Smoothed Wasserstein Distance

Improved fuzzy sparse multi-class least squares support vector machine

An improved least squares Twin Support Vector Machine

Semi-supervised Sparse Metric Learning Using Alternating Linearization Optimization

Joint Learning of Distance Metric and Kernel Classifier via Multiple Kernel Learning.

Discriminative Latent Subspace Learning with Adaptive Metric Learning

A Metric-Learning-Based Nonlinear Modeling Algorithm and Its Application in Key-Performance-Indicator Prediction

Two improvements for least squares support vector machines

A Novel Metric Learning Framework by Exploiting Global and Local Information

Low-Rank Similarity Metric Learning In High Dimensions

A Robust Least Squares Support Vector Machine Based on L∞-norm

Positive semidefinite support vector regression metric learning

Exploiting Inconsistency Problem in Multi-label Classification Via Metric Learning