Abstract:Based on a constructive learning approach, covering algorithms, we investigate the relationship between support vector sets and kernel functions in support vector machines (SVM). An interesting result is obtained. That is, in the linearly non-separable case, any sample of a given sample setK can become a support vector under a certain kernel function. The result shows that when the sample setK is linearly non-separable, although the chosen kernel function satisfies Mercer’s condition its corresponding support vector set is not necessarily the subset ofK that plays a crucial role in classifyingK. For a given sample set, what is the subset that plays the crucial role in classification? In order to explore the problem, a new concept, boundary or boundary points, is defined and its properties are discussed. Given a sample setK, we show that the decision functions for classifying the boundary points ofK are the same as that for classifying theK itself. And the boundary points ofK only depend onK and the structure of the space at whichK is located and independent of the chosen approach for finding the boundary. Therefore, the boundary point set may become the subset ofK that plays a crucial role in classification. These results are of importance to understand the principle of the support vector machine (SVM) and to develop new learning algorithms.

Relationship Between Support Vector Set and Kernel Functions in SVM

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Support Vector Machines Based on Information Geometry

A novel tree kernel support vector machine classifier for modeling the relationship between bioactivity and molecular descriptors

One Kind of Reduced Learning Algorithm for Support Vector Domain Description

Support Vector Machine Algorithm in Machine Learning

Online support vector machines with vectors sieving method

An information-geometrical method for improving the performance of support vector machine classifiers

Discriminant analysis via support vectors

Study on geometric approach of SVM algorithm-SK algorithm analysis and study

SVM Classification:Its Contents and Challenges

Support Feature Machines

Support vector machines and Radon's theorem

Balance Support Vector Machines Locally Using the Structural Similarity Kernel.

Neighbors' distribution property and sample reduction for support vector machines

Research of Support Vector Machines

Improvements to Train Support Vector Machines Based on Convex Set Conception

On-line Support Vector Machine Training Algorithm and Its Application

A Support Vector Machine with a Hybrid Kernel and Minimal Vapnik-Chervonenkis Dimension

Improving Support Vector Machine Classifiers By Modifying Kernel Functions

Interactive Support Vector Machine Learning Algorithm and Its Application