Linear Classification of data with Support Vector Machines and Generalized Support Vector Machines

Xiaomin Qi,Sergei Silvestrov,Talat Nazir
DOI: https://doi.org/10.1063/1.4972718
2016-05-31
Abstract:In this paper, we study the support vector machine and introduced the notion of generalized support vector machine for classification of data. We show that the problem of generalized support vector machine is equivalent to the problem of generalized variational inequality and establish various results for the existence of solutions. Moreover, we provide various examples to support our results.
Machine Learning
What problem does this paper attempt to address?
The paper attempts to address the application of Support Vector Machines (SVM) in data classification and its extended form—the Generalized Support Vector Machine (GSVM), including their theoretical foundations and practical applications. Specifically, the authors focus on the following points: 1. **Review of Standard Support Vector Machines (SVM)**: The paper first reviews the basic principles and applications of standard SVM, including its powerful performance in pattern classification and regression. SVM achieves classification by finding the optimal separating hyperplane, a process that involves minimizing a quadratic programming problem. 2. **Definition of Generalized Support Vector Machines (GSVM)**: The authors introduce the concept of Generalized Support Vector Machines and define a control function \( F: \mathbb{R}^n \to \mathbb{R}^n \). The goal of GSVM is to find parameters \( W \) and \( B \) that satisfy certain conditions to achieve the best classification effect. 3. **Existence Conditions for Generalized Support Vector Machines**: The authors provide sufficient conditions for the existence of solutions to the Generalized Support Vector Machine and prove the validity of these conditions. Specifically, they transform the GSVM problem into a generalized variational inequality problem and provide the corresponding mathematical proof. 4. **Empirical Validation**: To verify the effectiveness of the theoretical results, the authors provide several specific examples. These examples demonstrate how to use SVM and GSVM for data classification and compare the results of the two methods. In summary, this paper aims to expand the application scope of Support Vector Machines by introducing the concept of Generalized Support Vector Machines and providing both theoretical and practical support.