Abstract:Structural information is very important for improving the classification performance of classifiers. In order to increase the generalization performance of support vector machine (SVM) directly, several kinds of structured SVMs have been proposed. These algorithms with structural information only simply embed the global structural information or the local within-class information into SVM model. Thus, they sometimes are not suitable for real-world problems. To overcome the drawbacks, we firstly propose a novel SVM with local structural information (LSI-SVM) in this paper. In the LSI-SVM, the <i>K</i>-nearest neighbor (KNN) method is adopted. Applying the KNN method, the farthest neighbors set intra-class and the nearest neighbors set inter-class of the overall samples are obtained. It is more reasonable to maximize the margin between the nearest neighbors and the farthest neighbors. Both the global and local data structures are added into the optimization problem, making the LSI-SVM can fully utilize the underlying structural information and yield better performance. Furthermore, for nonlinear classification, the reproducing kernel Hilbert space theory is introduced and the kernel-based LSI-SVM is generated. What's more, in order to accelerate the training speed of LSI-SVM, a stochastic gradient LSI-SVM (LSI-SVM +) is constructed using the stochastic gradient descent (SGD) solver. Lastly, experimental results on regular-scale datasets, steel surface defects datasets, ORL face dataset and large-scale datasets demonstrate that both LSI-SVM and LSI-SVM + outperform other state-of-the-art algorithms on accuracy. In the meanwhile, our LSI-SVM + has high efficiency.

Application of Neighborhood Local Support Vector Machine in Image Classification

Image Classification Method Rationally Utilizing Spatial Information of the Image

Classification of Hyperspectral Remote Sensing Image Using Improved LS-SVM

A Novel Locally Linear Knn Model For Visual Recognition

Unified Locally Linear Classifiers with Diversity-Promoting Anchor Points

Local coding based matching kernel method for image classification

Local Mean Representation Based Classifier and Its Applications for Data Classification.

Stochastic gradient support vector machine with local structural information for pattern recognition

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Facial Expression Recognition from Image Sequences with LSVM

A New Locally Linear KNN Method with an Improved Marginal Fisher Analysis for Image Classification

A novel semi-supervised hyperspectral image classification approach based on spatial neighborhood information and classifier combination

A Kernel-Based Localization Approach in Wireless Sensor Networks

Local Naive Bayes Nearest Neighbor for Image Classification

Scalable Machine Learning Approaches for Neighborhood Classification Using Very High Resolution Remote Sensing Imagery

Locality Discriminative Coding for Image Classification

Facial Expression Recognition Based on Local SVM Classifiers

Semi-Supervised Classification Using Linear Neighborhood Propagation

Neighborhood Rough Sets Based Multi-Label Classification for Automatic Image Annotation

<Bold>Matching Images More Efficiently With Local Descriptors</Bold>

Comparative analysis of image classification algorithms based on traditional machine learning and deep learning