Abstract:Identifying the abnormal samples from a data set and determining their type are two key tasks of anomaly detection. However, the existing anomaly detection algorithms are generally faced with the defects of weak generalization ability and insufficient interpretation, the core reason of which is that they cannot mine specific features for different abnormal types. In this paper, a new anomaly detection algorithm aiming at feature selection for different abnormal types is developed. Inspired by self-supervised learning, we take the stationarity of variance changes of abnormal score similarity as a pretext task and combine it with wrapped search method. Then, the features and the corresponding parameters for different abnormal types can be screened to apply to the downstream task of anomaly integration detection. To verify the efficiency of the new algorithm, we conduct two sets of experiments to compare the new algorithm with 11 classical anomaly detection and 3 clustering anomaly detection algorithms on the data sets WDBC, WPBC and Wilt from DAMI database with the evaluation measures P@n, Adj-P@n, AP, Adj-AP and AUC. The experiment results show that, both in the identification and classification on abnormal samples, all performance measures of the new algorithm are explicitly better than that of the contrastive algorithms. Also, we apply the new algorithm to the Chinese auto insurance market, and find that the results can help managers to identify the main patterns of fraudulent claims and to summarize the feature combinations of fraud behaviors. In general, the new algorithm developed in this paper has the following advantages compared with traditional algorithms: 1) It can directly capture abnormal features and realize effective recognition of abnormal types, which effectively bridge the gap between abnormal judgement and feature screening. 2) Automatic screening of abnormal features can be completed under the condition of self-updating learning optimal strategy. 3) Only a few features are extracted from all features to reveal the abnormal characteristics, which significantly improves the interpretability and generalization ability of the algorithm and its results. In a word, through the novel self-supervised design method, feature screening is skillfully integrated into the anomaly detection task, which may provide a new way for anomaly detection research.

Tree-based Self-adaptive Anomaly Detection by Human-Machine Interaction

Human-machine interactive streaming anomaly detection by online self-adaptive forest

Anomaly Detection Algorithm Based on Electric Equipment

Interactive Context-Aware Anomaly Detection Guided by User Feedback

Hierarchical Context Representation and Self-adaptive Thresholding for Multivariate Anomaly Detection

Self-adaptive Statistical Process Control for Anomaly Detection in Time Series.

Can Tree Based Approaches Surpass Deep Learning in Anomaly Detection? A Benchmarking Study

Human-Machine Cooperative Video Anomaly Detection

Incorporating Feedback into Tree-based Anomaly Detection

An anomaly-introduced learning method for abnormal event detection

Fast Anomaly Detection for Streaming Data

Data Anomaly Intelligent Detection Based on Machine Learning

SALAD: Self-Adaptive Lightweight Anomaly Detection for Real-time Recurrent Time Series

A Novel Approach for Anomaly Detection in Data Streams: Fuzzy-statistical Detection Mode.

Self-Supervised Variational Graph Autoencoder for System-Level Anomaly Detection

AnomalyDetect: An Online Distance-Based Anomaly Detection Algorithm

Classification-Based Self-Supervised Learning For Anomaly Detection

A Self-Supervised Anomaly Detection Algorithm with Interpretability.

Deep Reinforced Active Learning for Time Series Anomaly Detection.

Interactive System-wise Anomaly Detection

AutoTSAD: Unsupervised Holistic Anomaly Detection for Time Series Data