Abstract:We propose a novel machine learning model for classification problems, Deep Twin Support Vector Machine(DTWSVM), which combines TWSVM with deep learning ideas. TWSVM is a successful algorithm for classification problems which seeks two nonparallel hyperplanes to make each hyperplane close to one class and far from the other as much as possible. And Deep Learning(DL) models have shown good ability in feature extraction and dimension reduction by constructing multi-layer network. Since the feature extraction in DL can reduce feature dimension while maintain the main information of original inputs, we consider constructing a threelayer network which contains input layer, hidden layer and output layer. We use two TWSVMs in the hidden layer to extract features based on the projection principle which is derived from Multi-Layer Perceptron(MLP). The two TWSVMs will get four hyperplanes by solving four convex quadratic programs. A new dataset which consists of the extracted features with four feature dimensions is produced from the hidden layer and then we can input it to the main TWSVM of the output layer to make final prediction. Similar as TWSVM, we design linear DTWSVM and nonlinear DTWSVM which have been proved to be very effective in classification problems. In numerical experiments, we have obtained 100% prediction accuracy for several datasets which is state-of-the-art performance absolutely!

Canonical Duality Solution for Alternating Support Vector Machine

Canonical Duality Solution to Support Vector Machine

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

An Incremental Updating Method for Support Vector Machines

M-estimator Based Support Vector Machine and Its Application

Incremental batch learning with support vector machines

On the proliferation of support vectors in high dimensions

Support Vector Machine Algorithm in Machine Learning

Support vector machine based direct inverse-model identification

A Support Vector Machine with a Hybrid Kernel and Minimal Vapnik-Chervonenkis Dimension

A Novel SVM and Its Application to Breast Cancer Diagnosis

Generalized version of the support vector machine for binary classification problems: supporting hyperplane machine

Support Vector Machines for Classification Problems

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems

A Coupled Similarity Kernel for Pairwise Support Vector Machine

Kernel-Free Universum Quadratic Surface Twin Support Vector Machines for Imbalanced Data

An information-geometrical method for improving the performance of support vector machine classifiers

New type of support vector machine by moving separating hyperplane

New method for solving Ivanov regularization-based support vector machine learning

A New Solution Method to Support Vector Machine Based on Arc Smoothing Function

Deep Twin Support Vector Machine