Abstract:Large-scale image classification has shown great importance in object recognition and image retrieval as the vast amounts of social multimedia sharing on the networks. While the time and memory requirements for SVM training surge with an increase in the sample size, which makes SVM impractical even for a moderate problem as the number of training data reaches to the extent of hundreds of thousands. To solve this problem, many specially designed algorithms are proposed such as clustering-based SVM training which attempts to remove the clustered data points that lie far away from support vectors. In this paper, we further explore that there exist clustered and scattered data points in a cluster. The clustered data points that lie around the clustering centroid are the dense data points, which are in the inner layer of a cluster. Those data points are viewed as having no SVs and removed. While the scattered data points are the sparse data points in the outside layer of a cluster. Those data points are viewed as having SVs and thus reserved. The Fisher Discriminant Ratio is employed to determine a boundary between the clustered and scattered data points in one cluster, which is computed based on the distance densities of data points to the cluster centroid. The redundant clustered data points in clusters are thus removed to speed up SVM training process. Several experimental results show that our proposed method has good classification accuracy while training time is significantly reduced. The training time in our proposed method only accounts for about 17 percent of the time in LIBSVM on the large data set of Covertype.

Using Support Vector Machines for Mining Regression Classes in Large Data Sets

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Association rules extraction based on support vector machines

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

M-estimator Based Support Vector Machine and Its Application

Mining Knowledge from Unbalanced Data Based on Ν-Support Vector Machine

Support vector machine classification and regression based hybrid modeling method and its application in Raman spectral analysis

Fuzzy Support Vector Machine For Regression Estimation

Approximate Approach to Train SVM on Very Large Data Sets

Sparse Least Squares Support Vector Machine for Function Estimation

Learning concepts from large scale imbalanced data sets using support cluster machines.

Mining Knowledge from Unbalanced Data: Effect of Class Distribution on SVM Classification

Online support vector machines with vectors sieving method

Multi-scale support vector machine for regression estimation

A Large Dimensional Analysis of Least Squares Support Vector Machines

Least Square Generalized Support Vector Machines for Regression

Scalable Semisupervised GMM for Big Data Quality Prediction in Multimode Processes.

Large-scale support vector machine classification with redundant data reduction

Using data mining techniques for decision support in agriculture: support vector machines

Random matrices meet machine learning: a large dimensional analysis of LS-SVM

Improvement of Support Vector Machine Algorithm in Big Data Background