Abstract:Support vector machines (SVMs) have been a dominant machine learning technique for more than a decade. The intuitive principle behind SVM training is to find the maximum margin separating hyperplane for a given set of binary labeled training data. Previously, SVMs have been primarily applied to supervised learning problems, where target class labels are provided with the data. Developing unsupervised extensions to SVMs, where no class labels are given, turns out to be a challenging problem. In this dissertation, I propose a principled approach for unsupervised and semi-supervised SVM training by formulating convex relaxations of the natural training criterion: find a (constrained) labeling that would yield an optimal SVM classifier on the resulting labeled training data. This relaxation yields a semidefinite program (SDP) that can be solved in polynomial time. The resulting training procedures can be applied to two-class and multi-class problems, and ultimately to the multivariate case, achieving high quality results in each case. In addition to unsupervised training, I also consider the problem of reducing the outlier sensitivity of standard supervised SVM training. Here I show that a similar convex relaxation can be applied to improve the robustness of SVMs by explicitly suppressing outliers in the training process. The proposed approach can achieve superior results to standard SVMs in the presence of outliers.

Unsupervised and Semi-supervised Lagrangian Support Vector Machines

Unsupervised and Semi-Supervised Two-class Support Vector Machines

New unsupervised support vector machines

Unsupervised and Semi-supervised Lagrangian Support Vector Machines with Polyhedral Perturbations

Robust Unsupervised and Semi-Supervised Bounded V - Support Vector Machines

Unsupervised and Semi-Supervised Bounded V-Support Vector Machines with Polyhedral Perturbations

Unsupervised and Semi-Supervised Bounded C-Support Vector Machines with Polyhedral Perturbations

Unsupervised Support Vector Machines with Perturbations

Robust Unsupervised Lagrangian Support Vector Machines For Supply Chain Management

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

Optimization meets Machine Learning: An Exact Algorithm for Semi-Supervised Support Vector Machines

A New Semi-Supervised Classifier Based on Maximum Vector-Angular Margin

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

Convex large margin training techniques: unsupervised, semi-supervised, and robust support vector machines

Unsupervised and Semi-supervised Support Vector Machines

Semi-supervised Image Classification Via Nonnegative Least-Squares Regression

Lagrangian supervised and semi-supervised extreme learning machine

Linear Multi-Class Classification Support Vector Machine

Support Vector Machines for Classification Problems

Semisupervised Support Vector Machines with Tangent Space Intrinsic Manifold Regularization.

A Convex Relaxation Framework for a Class of Semi-Supervised Learning Methods and Its Application in Pattern Recognition