Abstract:Large-scale image classification has shown great importance in object recognition and image retrieval as the vast amounts of social multimedia sharing on the networks. While the time and memory requirements for SVM training surge with an increase in the sample size, which makes SVM impractical even for a moderate problem as the number of training data reaches to the extent of hundreds of thousands. To solve this problem, many specially designed algorithms are proposed such as clustering-based SVM training which attempts to remove the clustered data points that lie far away from support vectors. In this paper, we further explore that there exist clustered and scattered data points in a cluster. The clustered data points that lie around the clustering centroid are the dense data points, which are in the inner layer of a cluster. Those data points are viewed as having no SVs and removed. While the scattered data points are the sparse data points in the outside layer of a cluster. Those data points are viewed as having SVs and thus reserved. The Fisher Discriminant Ratio is employed to determine a boundary between the clustered and scattered data points in one cluster, which is computed based on the distance densities of data points to the cluster centroid. The redundant clustered data points in clusters are thus removed to speed up SVM training process. Several experimental results show that our proposed method has good classification accuracy while training time is significantly reduced. The training time in our proposed method only accounts for about 17 percent of the time in LIBSVM on the large data set of Covertype.

A hybrid method for speeding SVM training

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

An Incremental Updating Method for Support Vector Machines

Approximate Approach to Train SVM on Very Large Data Sets

A Geometric Approach To Train Svm On Very Large Data Sets

A Method for Vehicle Detection Based on Local Gradients Vector

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Hybrid optimization of feature selection and SVM training model

A New Method of Sample Reduction for Support Vector Classification

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

Simplified support vector machines via kernel-based clustering

Fast Pruning Superfluous Support Vectors in SVMs

A simple and reliable instance selection for fast training support vector machine: Valid Border Recognition

Large-scale support vector machine classification with redundant data reduction

Fast SVM training using edge detection on very large datasets

Fast extraction strategy of support vector machines

Pair-wise sequential reduced set for optimization of support vector machines

Fast instance selection method for SVM training based on fuzzy distance metric