Abstract:Anomaly detection plays an important role in industry, especially in ensuring system safety and product quality. Due to the unavailability of anomalous data in many practical cases, anomaly detection is usually solved by one-class classification (OCC) methods using only normal data. As a classical OCC method, one-class support vector machine (OCSVM) is a popular discriminative approach for anomaly detection, which detects abnormal data points by establishing a decision boundary in the kernel space. However, the performance of OCSVM heavily relies on kernel parameters, whose selection is not trivial for anomaly detection problems. Moreover, for some uneven and complex data distributions, different data regions may have quite different densities and shapes, making it difficult for OCSVM to obtain good boundaries in all regions using a global kernel parameter. To address the above two issues, in this article, we propose a hybrid algorithm incorporating vector quantization and OCSVM (VQ-OCSVM). Specifically, vector quantization is used to extract distribution information of normal data, and the results are used to construct an explicit mapping function to map data into a high-dimensional feature space. Then, OCSVM is performed in the feature space to build a classifier. By introducing the explicit mapping into OCSVM, the proposed method can effectively bypass the kernel parameter selection problem of the classical OCSVM method. Furthermore, the constructed mapping carries the data distribution information, and the VQ-OCSVM model can be regarded as an integration of generative learning and discriminative learning. The complementary properties of these two paradigms make the proposed VQ-OCSVM algorithm have better generalization capacity for complex data distribution. Both qualitative and quantitative experimental results demonstrate the effectiveness and advantages of the proposed method.

An Approach to Choosing Gaussian Kernel Parameter for One-Class SVMs Via Tightness Detecting

Parameter selection of Gaussian kernel for one-class SVM.

Two Methods of Selecting Gaussian Kernel Parameters for One-Class Svm and Their Application to Fault Detection

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Novel Linear Search for Support Vector Machine Parameter Selection

The Optimization for Parameter of Kernel Function with GA

Swarm Intelligent Tuning Of One-Class V-Svm Parameters

Simple, fast and accurate hyper-parameter tuning in Gaussian-kernel SVM

Behavioral analysis of support vector machine classifier with Gaussian kernel and imbalanced data

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Efficient Selection of Gaussian Kernel SVM Parameters for Imbalanced Data

Hyperparameter Selection for Gaussian Process One-Class Classification.

A New Method for Determining the Parameter of Gaussian Kernel

One class SVM model based on neural tangent kernel for anomaly detection task on small-scale data

MaxMin-L2-SVC-NCH: A Novel Approach for Support Vector Classifier Training and Parameter Selection

Fast Incremental Learning Method for One-Class Support Vector Machine

A Hybrid Algorithm Incorporating Vector Quantization and One-Class Support Vector Machine for Industrial Anomaly Detection

An information-geometrical method for improving the performance of support vector machine classifiers

Robust One-Class SVM for Fault Detection

An Autotuning-based Optimization Framework for Mixed-kernel SVM Classifications in Smart Pixel Datasets and Heterojunction Transistors