Abstract:Support vector machines (SVM) has achieved great success in multi-class classification. However, with the increase in dimension, the irrelevant or redundant features may degrade the generalization performances of the SVM classifiers, which make dimensionality reduction (DR) become indispensable for high-dimensional data. At present, most of the DR algorithms reduce all data points to the same dimension for multi-class datasets, or search the local latent dimension for each class, but they neglect the fact that different class pairs also have different local latent dimensions. In this paper, we propose an adaptive class pairwise dimensionality reduction algorithm (ACPDR) to improve the generalization performances of the multi-class SVM classifiers. In the proposed algorithm, on the one hand, different class pairs are reduced to different dimensions; on the other hand, a tabu strategy is adopted to select adaptively a suitable embedding dimension. Five popular DR algorithms are employed in our experiment, and the numerical results on some benchmark multi-class datasets show that compared with the traditional DR algorithms, the proposed ACPDR can improve the generalization performances of the multi-class SVM classifiers, and also verify that it is reasonable to consider the different class pairs have different local dimensions.

Effect analysis of dimension reduction on support vector machines

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

One Kind of Reduced Learning Algorithm for Support Vector Domain Description

Recursive support vector machines for dimensionality reduction.

Research and implementation of SVD in machine learning

Feature Selection for Support Vector Machines in Text Categorization

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

Discriminant analysis via support vectors

Dimensionality Reduction and Pattern Classification Method Based on the SVM and PCA

A dissimilarity based kernel space for support vector machines

A Large Dimensional Analysis of Least Squares Support Vector Machines

A Support Vector Machine with a Hybrid Kernel and Minimal Vapnik-Chervonenkis Dimension

Principal support vector machines for linear and nonlinear sufficient dimension reduction

Dimension Reduction Method of Support Vector Machine Based on Gram-Schmidt Process

Supervised Linear Dimension-Reduction Methods: Review, Extensions, and Comparisons

A Survey On Dimension Reduction Techniques In Text Classification

Study On Optimization Of Support Vectors

Feature Analysis: Support Vector Machines Approaches

Support Vector Discriminant Analysis and Its Application to Facial Expression Recognition

On partial sufficient dimension reduction with applications to partially linear multi-index models

An Adaptive Class Pairwise Dimensionality Reduction Algorithm