Abstract:Anomaly detection plays an important role in industry, especially in ensuring system safety and product quality. Due to the unavailability of anomalous data in many practical cases, anomaly detection is usually solved by one-class classification (OCC) methods using only normal data. As a classical OCC method, one-class support vector machine (OCSVM) is a popular discriminative approach for anomaly detection, which detects abnormal data points by establishing a decision boundary in the kernel space. However, the performance of OCSVM heavily relies on kernel parameters, whose selection is not trivial for anomaly detection problems. Moreover, for some uneven and complex data distributions, different data regions may have quite different densities and shapes, making it difficult for OCSVM to obtain good boundaries in all regions using a global kernel parameter. To address the above two issues, in this article, we propose a hybrid algorithm incorporating vector quantization and OCSVM (VQ-OCSVM). Specifically, vector quantization is used to extract distribution information of normal data, and the results are used to construct an explicit mapping function to map data into a high-dimensional feature space. Then, OCSVM is performed in the feature space to build a classifier. By introducing the explicit mapping into OCSVM, the proposed method can effectively bypass the kernel parameter selection problem of the classical OCSVM method. Furthermore, the constructed mapping carries the data distribution information, and the VQ-OCSVM model can be regarded as an integration of generative learning and discriminative learning. The complementary properties of these two paradigms make the proposed VQ-OCSVM algorithm have better generalization capacity for complex data distribution. Both qualitative and quantitative experimental results demonstrate the effectiveness and advantages of the proposed method.

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

Fast Incremental Learning Method for One-Class Support Vector Machine

Training support vector data descriptors using converging linear particle swarm optimization

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

An On-Line Learning Approach with Support Vector Dormain Classifier

Recursive Training Algorithm for One-Class Support Vector Machine Based on Active Set Method

A Sampling-based SMO Algorithm

Fast Training of Support Vector Machines using Sequential Minimal Optimization

Fast training of support vector machines using sequential minimal optimization, advances in kernel methods

Combining Boundary Detector and SND-SVM for Fast Learning.

Hierarchical 1-FSVM Algorithm Based on SMO

A new strategy for selecting working sets applied in SMO

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

A New Working Set Selection For Smo-Type Decomposition Methods

A New Method of Sample Reduction for Support Vector Classification

A Fast Online SVM Algorithm for Multi-user Detection

A Hybrid Algorithm Incorporating Vector Quantization and One-Class Support Vector Machine for Industrial Anomaly Detection

A Fast Iterative Single Data Approach to Training Unconstrained Least Squares Support Vector Machines

A Novel Model of Working Set Selection for SMO Decomposition Methods