Abstract:Anomaly detection is of paramount importance in many real-world domains characterized by evolving behavior, such as monitoring cyber-physical systems, human conditions and network traffic. Current research in anomaly detection leverages offline learning working with static data or online learning focusing on constant adaptation to evolving data. At the same time, lifelong learning represents an emerging trend, answering the need for machine learning models that continuously adapt to new challenges in dynamic environments while retaining past knowledge. Although this aspect could be beneficial to build effective and robust anomaly detection models, lifelong learning research is mainly dedicated to proposing new model update strategies in image classification and reinforcement learning domains. The limited scope addressed by lifelong learning works thus far creates a gap in understanding whether such techniques and capabilities can be fruitfully exploited in anomaly detection contexts, which represents the main motivation of this paper. More specifically, anomaly detection provides unique challenges, such as an evolving normal class and limited availability of anomalies, which significantly differs from the landscape and scenarios of lifelong image classification and reinforcement learning. In this paper, we face this issue by exploring, motivating, and discussing lifelong anomaly detection, as well as providing foundations with regard to scenarios, strategies, and metrics. First, we explain why lifelong anomaly detection is relevant, defining challenges and opportunities to design anomaly detection methods that deal with lifelong learning complexities. Second, we formulate and characterize lifelong learning settings tailored for anomaly detection problems, and design a scenario generation procedure that enables researchers to experiment with lifelong anomaly detection using existing datasets. Third, we perform experiments with popular anomaly detection methods on proposed lifelong scenarios, emphasizing the gap in performance that could be filled with the adoption of lifelong learning. In summary, our efforts are directed at assessing the performance of non-lifelong anomaly detection models in lifelong scenarios and how the adoption of lifelong learning impacts their learning capabilities. Overall, we conclude that the adoption of lifelong anomaly detection is important to design more robust models that provide a comprehensive view of the environment, as well as simultaneous adaptation and knowledge retention.

Continuous image anomaly detection based on contrastive lifelong learning

Transformer-based contrastive learning framework for image anomaly detection

Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection

Online Continual Learning with Contrastive Vision Transformer

Unsupervised Industrial Anomaly Detection via Pattern Generative and Contrastive Networks

Continuous Memory Representation for Anomaly Detection

Abnormal Event Detection Using Deep Contrastive Learning for Intelligent Video Surveillance System

Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights

A Transformer Architecture based mutual attention for Image Anomaly Detection

Augment to Detect Anomalies with Continuous Labelling

Preventing Catastrophic Forgetting through Memory Networks in Continuous Detection

Continual Contrastive Learning for Image Classification

Time-series Anomaly Detection via Contextual Discriminative Contrastive Learning

Continual Contrastive Self-supervised Learning for Image Classification.

Continual Learning Approaches for Anomaly Detection

A Comparison of Supervised and Unsupervised Deep Learning Methods for Anomaly Detection in Images

Contrastive Attention for Video Anomaly Detection

Continuous Transformation Learning of Translation Invariant Representations

Multi-Contextual Predictions with Vision Transformer for Video Anomaly Detection

CL-Flow:Strengthening the Normalizing Flows by Contrastive Learning for Better Anomaly Detection

Vision-Language Interaction via Contrastive Learning for Surface Anomaly Detection in Consumer Electronics Manufacturing