Abstract:Anomaly detection plays an important role in industry, especially in ensuring system safety and product quality. Due to the unavailability of anomalous data in many practical cases, anomaly detection is usually solved by one-class classification (OCC) methods using only normal data. As a classical OCC method, one-class support vector machine (OCSVM) is a popular discriminative approach for anomaly detection, which detects abnormal data points by establishing a decision boundary in the kernel space. However, the performance of OCSVM heavily relies on kernel parameters, whose selection is not trivial for anomaly detection problems. Moreover, for some uneven and complex data distributions, different data regions may have quite different densities and shapes, making it difficult for OCSVM to obtain good boundaries in all regions using a global kernel parameter. To address the above two issues, in this article, we propose a hybrid algorithm incorporating vector quantization and OCSVM (VQ-OCSVM). Specifically, vector quantization is used to extract distribution information of normal data, and the results are used to construct an explicit mapping function to map data into a high-dimensional feature space. Then, OCSVM is performed in the feature space to build a classifier. By introducing the explicit mapping into OCSVM, the proposed method can effectively bypass the kernel parameter selection problem of the classical OCSVM method. Furthermore, the constructed mapping carries the data distribution information, and the VQ-OCSVM model can be regarded as an integration of generative learning and discriminative learning. The complementary properties of these two paradigms make the proposed VQ-OCSVM algorithm have better generalization capacity for complex data distribution. Both qualitative and quantitative experimental results demonstrate the effectiveness and advantages of the proposed method.

The Support Vector Machine Model and Application Based on Particle Swarm Optimization Algorithm

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Training support vector data descriptors using converging linear particle swarm optimization

An Improved Support Vector Machine Attack Detection Algorithm for Industry Controls System

A robust reliability prediction method using Weighted Least Square Support Vector Machine equipped with Chaos Modified Particle Swarm Optimization and Online Correcting Strategy

A Novel SVM by Combining Kernel Principal Component Analysis and Improved Chaotic Particle Swarm Optimization for Intrusion Detection

A Hybrid Particle Swarm Optimization Algorithm with Dynamic Adjustment of Inertia Weight Based on a New Feature Selection Method to Optimize SVM Parameters

Quantum-Behaved Particle Swarm Optimization for Parameter Optimization of Support Vector Machine

A New Intelligent Intrusion Detection Method Based on Attribute Reduction and Parameters Optimization of SVM

Machine Learning-driven optimization for SVM-based intrusion detection system in vehicular ad hoc networks

Parameter Optimization of Support Vector Machine Using Dragonfly Algorithm

A Hybrid Algorithm Incorporating Vector Quantization and One-Class Support Vector Machine for Industrial Anomaly Detection

The Application of Chaotic Particle Swarm Optimization Algorithm in Power System Load Forecasting

Hybrid optimization of feature selection and SVM training model

Parameters optimization of support vector machines for imbalanced data using social ski driver algorithm

Hyper-parameter tuning for support vector machine using an improved cat swarm optimization algorithm

A New Approach to Optimize SVM for Insulator State Identification Based on Improved PSO Algorithm

A novel differential particle swarm optimization for parameter selection of support vector machines for monitoring metal-oxide surge arrester conditions

A Novel Feature-Selection Approach Based on Particle Swarm Optimization Algorithm for Intrusion Detection Systems (Workshop Paper)