Abstract:Anomaly detection plays an important role in industry, especially in ensuring system safety and product quality. Due to the unavailability of anomalous data in many practical cases, anomaly detection is usually solved by one-class classification (OCC) methods using only normal data. As a classical OCC method, one-class support vector machine (OCSVM) is a popular discriminative approach for anomaly detection, which detects abnormal data points by establishing a decision boundary in the kernel space. However, the performance of OCSVM heavily relies on kernel parameters, whose selection is not trivial for anomaly detection problems. Moreover, for some uneven and complex data distributions, different data regions may have quite different densities and shapes, making it difficult for OCSVM to obtain good boundaries in all regions using a global kernel parameter. To address the above two issues, in this article, we propose a hybrid algorithm incorporating vector quantization and OCSVM (VQ-OCSVM). Specifically, vector quantization is used to extract distribution information of normal data, and the results are used to construct an explicit mapping function to map data into a high-dimensional feature space. Then, OCSVM is performed in the feature space to build a classifier. By introducing the explicit mapping into OCSVM, the proposed method can effectively bypass the kernel parameter selection problem of the classical OCSVM method. Furthermore, the constructed mapping carries the data distribution information, and the VQ-OCSVM model can be regarded as an integration of generative learning and discriminative learning. The complementary properties of these two paradigms make the proposed VQ-OCSVM algorithm have better generalization capacity for complex data distribution. Both qualitative and quantitative experimental results demonstrate the effectiveness and advantages of the proposed method.

Support vector machine algorithm based on Gaussian mixture model and spatial ambiguity

M-estimator Based Support Vector Machine and Its Application

Facial feature points detecting based on Gaussian Mixture Models

A new improved support vector machine: QGA-SVM

Semantic-oriented 3D model classification and retrieval using Gaussian processes

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

A Hybrid Algorithm Incorporating Vector Quantization and One-Class Support Vector Machine for Industrial Anomaly Detection

Fuzzy Support Vector Machine Based on Affinity among Samples

Unsupervised Classification Based on Penalized Maximum Likelihood of Gaussian Mixture Models

Subspace Clustering By Mixture Of Gaussian Regression

A new hybrid discriminative/generative model using the full-covariance multivariate generalized Gaussian mixture models

Entropy Penalized Automated Model Selection On Gaussian Mixture

Gaussian Mixture Learning Via Robust Competitive Agglomeration

The Supervised Learning Gaussian Mixture Model

A multi-manifold semi-supervised Gaussian mixture model for pattern classification

Probabilistic support vector machine output adjusting for sampling bias

Optimal Multi-model Detection with Application to Gaussian Problems

Optimization of Gaussian mixture model motion detection algorithm

Mixture of Support Vector Machines for Text-Independent Speaker Recognition

Probabilistic SVM classifier ensemble selection based on GMDH-type neural network

Gaussian mixture model and Markov random fields for hyperspectral image classification