Abstract:Unsupervised Anomaly Detection (UAD) is a key data mining problem owing to its wide real-world applications. Due to the complete absence of supervision signals, UAD methods rely on implicit assumptions about anomalous patterns (e.g., scattered/sparsely/densely clustered) to detect anomalies. However, real-world data are complex and vary significantly across different domains. No single assumption can describe such complexity and be valid in all scenarios. This is also confirmed by recent research that shows no UAD method is omnipotent. Based on above observations, instead of searching for a magic universal winner assumption, we seek to design a general UAD Booster (UADB) that empowers any UAD models with adaptability to different data. This is a challenging task given the heterogeneous model structures and assumptions adopted by existing UAD methods. To achieve this, we dive deep into the UAD problem and find that compared to normal data, anomalies (i) lack clear structure/pattern in feature space, thus (ii) harder to learn by model without a suitable assumption, and finally, leads to (iii) high variance between different learners. In light of these findings, we propose to (i) distill the knowledge of the source UAD model to an imitation learner (booster) that holds no data assumption, then (ii) exploit the variance between them to perform automatic correction, and thus (iii) improve the booster over the original UAD model. We use a neural network as the booster for its strong expressive power as a universal approximator and ability to perform flexible post-hoc tuning. Note that UADB is a model-agnostic framework that can enhance heterogeneous UAD models in a unified way. Extensive experiments on over 80 tabular datasets demonstrate the effectiveness of UADB.

Spiking Reinforcement Learning for Weakly-Supervised Anomaly Detection

Deep Anomaly Detection and Search via Reinforcement Learning

Deep Anomaly Detection and Search Via Reinforcement Learning (student Abstract)

Toward Deep Supervised Anomaly Detection: Reinforcement Learning from Partially Labeled Anomaly Data

Deep Anomaly Detection Via Active Anomaly Search.

Weakly Supervised Anomaly Detection: A Survey

AnoOnly: Semi-Supervised Anomaly Detection with the Only Loss on Anomalies

ADSAD: An unsupervised attention-based discrete sequence anomaly detection framework for network security analysis

AnoRand: A Semi Supervised Deep Learning Anomaly Detection Method by Random Labeling

SNN-AAD: Active Anomaly Detection Method for Multivariate Time Series with Sparse Neural Network

Weakly Supervised Anomaly Detection via Knowledge-Data Alignment

Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detection

Deep anomaly detection with self-supervised learning and adversarial training

LDAAD: an Effective Label De-noising Approach for Anomaly Detection

Supervised Anomaly Detection via Conditional Generative Adversarial Network and Ensemble Active Learning

Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for Supervised Anomaly Detection

UADB: Unsupervised Anomaly Detection Booster

A Novel Semi-supervised Anomaly Detection Method for Network Intrusion Detection

Semi-Supervised Anomaly Detection via Neural Process

Meta pseudo labels for anomaly detection via partially observed anomalies

Application of Improved Asynchronous Advantage Actor Critic Reinforcement Learning Model on Anomaly Detection