Abstract:Anomaly detection plays an important role in industry, especially in ensuring system safety and product quality. Due to the unavailability of anomalous data in many practical cases, anomaly detection is usually solved by one-class classification (OCC) methods using only normal data. As a classical OCC method, one-class support vector machine (OCSVM) is a popular discriminative approach for anomaly detection, which detects abnormal data points by establishing a decision boundary in the kernel space. However, the performance of OCSVM heavily relies on kernel parameters, whose selection is not trivial for anomaly detection problems. Moreover, for some uneven and complex data distributions, different data regions may have quite different densities and shapes, making it difficult for OCSVM to obtain good boundaries in all regions using a global kernel parameter. To address the above two issues, in this article, we propose a hybrid algorithm incorporating vector quantization and OCSVM (VQ-OCSVM). Specifically, vector quantization is used to extract distribution information of normal data, and the results are used to construct an explicit mapping function to map data into a high-dimensional feature space. Then, OCSVM is performed in the feature space to build a classifier. By introducing the explicit mapping into OCSVM, the proposed method can effectively bypass the kernel parameter selection problem of the classical OCSVM method. Furthermore, the constructed mapping carries the data distribution information, and the VQ-OCSVM model can be regarded as an integration of generative learning and discriminative learning. The complementary properties of these two paradigms make the proposed VQ-OCSVM algorithm have better generalization capacity for complex data distribution. Both qualitative and quantitative experimental results demonstrate the effectiveness and advantages of the proposed method.

OAA-SVM-MS: A fast and efficient multi-class classification algorithm

Generalization Capacity of Multi-class SVM Based on Markovian Resampling

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

A Multi-Class Large Margin Classifier

Fast Incremental Learning Method for One-Class Support Vector Machine

Novel One-Vs-rest Classifier Based on SVM and Multi-Spheres

Improved support vector machine for multi-class classification problems

M-estimator Based Support Vector Machine and Its Application

A new improved support vector machine: QGA-SVM

Fast Extended One-Versus-Rest Multi-Label Support Vector Machine Using Approximate Extreme Points.

MK-MSMCR: An efficient multiple kernel approach to multi-class classification

A Class-Incremental Learning Method Based on One Class Support Vector Machine

Distributed Online One-Class Support Vector Machine for Anomaly Detection over Networks

A Hybrid Algorithm Incorporating Vector Quantization and One-Class Support Vector Machine for Industrial Anomaly Detection

One-against-all Multi-Class SVM Classification Using Reliability Measures

One-class support vector machines for large-scale data sets

A multiclass classification using one-versus-all approach with the differential partition sampling ensemble

Multi-sphere Classification Algorithm Based on 1-SVM

A Fast Online SVM Algorithm for Multi-user Detection

Applying Multi-CLASS Support Vector Machines: One-vs.-One vs. One-vs.-All on the UWF-ZeekDataFall22 Dataset