Abstract:Support vector machine (SVM), as an effective method in classification problems, tries to find the optimal hyperplane that maximizes the margin between two classes and can be obtained by solving a constrained optimization criterion using quadratic programming (QP). This QP leads to higher computational cost. Least squares support vector machine (LS-SVM), as a variant of SVM, tries to avoid the above shortcoming and obtain an analytical solution directly from solving a set of linear equations instead of QP. Both SVM and LS-SVM operate directly on patterns represented by vector, i.e., before applying SVM or LS-SVM to a pattern, any non-vector pattern such as an image has to be first vectorized into a vector pattern by some techniques like concatenation. However, some implicit structural or local contextual information may be lost in this transformation. Moreover, as the dimension d of the weight vector in SVM or LS-SVM with the linear kernel is equal to the dimension d 1 × d 2 of the original input pattern, as a result, the higher the dimension of a vector pattern is, the more space is needed for storing it. In this paper, inspired by the method of feature extraction directly based on matrix patterns and the advantages of LS-SVM, we propose a new classifier design method based on matrix patterns, called MatLSSVM, such that the new method can not only directly operate on original matrix patterns, but also efficiently reduce memory for the weight vector ( d ) from d 1 × d 2 to d 1 + d 2 . However like LS-SVM, MatLSSVM inherits LS-SVM’s existence of unclassifiable regions when extended to multi-class problems. Thus with the fuzzy version of LS-SVM, a corresponding fuzzy version of MatLSSVM (MatFLSSVM) is further proposed to remove unclassifiable regions effectively for multi-class problems. Experimental results on some benchmark datasets show that the proposed method is competitive in classification performance compared to LS-SVM, fuzzy LS-SVM (FLS-SVM), more-recent MatPCA and MatFLDA. In addition, more importantly, the idea used here has a possibility of providing a novel way of constructing learning model.

Mixed-norm linear support vector machine

Least squares support vector machine based partially linear model identification

L2P-Norm Distance Twin Support Vector Machine.

Feature Selection Via L P -Norm Support Vector Machines

A 1-Norm Regularized Linear Programming Nonparallel Hyperplane Support Vector Machine for Binary Classification Problems

Minimal Support Vector Machine

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

Using Svm To Model And Control Nonlinear Dynamical Systems

Least Squares Support Vector Machines Based on Support Vector Degrees

Unified Locally Linear Classifiers with Diversity-Promoting Anchor Points

On $\ell_p$-Support Vector Machines and Multidimensional Kernels

A Feature Selection Method for Nonparallel Plane Support Vector Machine Classification

L1-norm Loss-Based Projection Twin Support Vector Machine for Binary Classification

A nonlinear kernel SVM classifier via L 0 / 1 soft-margin loss with classification performance

L-P Norm Localized Multiple Kernel Learning Via Semi-Definite Programming

Non-smooth optimization algorithm to solve the LINEX soft support vector machine

Improved 2-norm Based Fuzzy Least Squares Twin Support Vector Machine

Hierarchical Mixing Linear Support Vector Machines for Nonlinear Classification

New Least Squares Support Vector Machines Based on Matrix Patterns

Asymmetric Least Squares Support Vector Machine Classifiers

Mass classification of benign and malignant with a new twin support vector machine joint l_2,1 -norm