Abstract:Support vector machines (SVMs) have been a dominant machine learning technique for more than a decade. The intuitive principle behind SVM training is to find the maximum margin separating hyperplane for a given set of binary labeled training data. Previously, SVMs have been primarily applied to supervised learning problems, where target class labels are provided with the data. Developing unsupervised extensions to SVMs, where no class labels are given, turns out to be a challenging problem. In this dissertation, I propose a principled approach for unsupervised and semi-supervised SVM training by formulating convex relaxations of the natural training criterion: find a (constrained) labeling that would yield an optimal SVM classifier on the resulting labeled training data. This relaxation yields a semidefinite program (SDP) that can be solved in polynomial time. The resulting training procedures can be applied to two-class and multi-class problems, and ultimately to the multivariate case, achieving high quality results in each case. In addition to unsupervised training, I also consider the problem of reducing the outlier sensitivity of standard supervised SVM training. Here I show that a similar convex relaxation can be applied to improve the robustness of SVMs by explicitly suppressing outliers in the training process. The proposed approach can achieve superior results to standard SVMs in the presence of outliers.

A Novel Algorithm to Train Support Vector Machine Based on Convex Optimization Theory

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Improvements to Train Support Vector Machines Based on Convex Set Conception

Incremental Learning Algorithm Based on Support Vector Machine

An On-Line Learning Approach with Support Vector Dormain Classifier

One Kind of Reduced Learning Algorithm for Support Vector Domain Description

On-line Support Vector Machine Training Algorithm and Its Application

Training support vector data descriptors using converging linear particle swarm optimization

A Novel Fast Support Vector Machine Based on Support Vector Geometry Analysis

A Novel Vectors Surgeon Machine Based on Statistical Learning Theory

Online support vector machines with vectors sieving method

Efficient Convex Relaxation for Transductive Support Vector Machine.

Support vector machine adaptive control of nonlinear systems

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Convex large margin training techniques: unsupervised, semi-supervised, and robust support vector machines

Two New Decomposition Algorithms for Training Bound-Constrained Support Vector Machines

A Novel Approach to Pre-Extracting Support Vectors Based on the Theory of Belief Functions.

Support Vector Machine Algorithm in Machine Learning

Canonical Duality Solution to Support Vector Machine

A Survey on Training Algorithms for Support Vector Machine