Abstract:Anomaly detection is of paramount importance in many real-world domains characterized by evolving behavior, such as monitoring cyber-physical systems, human conditions and network traffic. Current research in anomaly detection leverages offline learning working with static data or online learning focusing on constant adaptation to evolving data. At the same time, lifelong learning represents an emerging trend, answering the need for machine learning models that continuously adapt to new challenges in dynamic environments while retaining past knowledge. Although this aspect could be beneficial to build effective and robust anomaly detection models, lifelong learning research is mainly dedicated to proposing new model update strategies in image classification and reinforcement learning domains. The limited scope addressed by lifelong learning works thus far creates a gap in understanding whether such techniques and capabilities can be fruitfully exploited in anomaly detection contexts, which represents the main motivation of this paper. More specifically, anomaly detection provides unique challenges, such as an evolving normal class and limited availability of anomalies, which significantly differs from the landscape and scenarios of lifelong image classification and reinforcement learning. In this paper, we face this issue by exploring, motivating, and discussing lifelong anomaly detection, as well as providing foundations with regard to scenarios, strategies, and metrics. First, we explain why lifelong anomaly detection is relevant, defining challenges and opportunities to design anomaly detection methods that deal with lifelong learning complexities. Second, we formulate and characterize lifelong learning settings tailored for anomaly detection problems, and design a scenario generation procedure that enables researchers to experiment with lifelong anomaly detection using existing datasets. Third, we perform experiments with popular anomaly detection methods on proposed lifelong scenarios, emphasizing the gap in performance that could be filled with the adoption of lifelong learning. In summary, our efforts are directed at assessing the performance of non-lifelong anomaly detection models in lifelong scenarios and how the adoption of lifelong learning impacts their learning capabilities. Overall, we conclude that the adoption of lifelong anomaly detection is important to design more robust models that provide a comprehensive view of the environment, as well as simultaneous adaptation and knowledge retention.

Pseudo Replay-based Class Continual Learning for Online New Category Anomaly Detection in Advanced Manufacturing

Continual Recognition with Adaptive Memory Update.

Context-aware Feature Reconstruction for Class-Incremental Anomaly Detection and Localization

ONER: Online Experience Replay for Incremental Anomaly Detection

AdaER: An Adaptive Experience Replay Approach for Continual Lifelong Learning

Learning with supervised data for anomaly detection in smart manufacturing

Mixed-Up Experience Replay for Adaptive Online Condition Monitoring

Continual Learning in Predictive Autoscaling

An Encoder-Decoder Based Approach for Anomaly Detection with Application in Additive Manufacturing

Data-driven Unsupervised Anomaly Detection of Manufacturing Processes with Multi-Scale Prototype Augmentation and Multi-Sensor Data

Memory-Enhanced Spatial-Temporal Encoding Framework for Industrial Anomaly Detection System

Squeezing More Past Knowledge for Online Class-Incremental Continual Learning

A Complementary Continual Learning Framework Using Incremental Samples for Remaining Useful Life Prediction of Machinery

Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights

An Adaptive Continual Learning Method for Nonstationary Industrial Time Series Prediction

Toward Lifelong Learning for Industrial Defect Classification: A Proposed Framework

Online Abnormal Interval Detection and Classification of Industrial Time Series Data Based on Multi-Scale Deep Learning

Online continual learning in image classification: An empirical survey

Look At Me, No Replay! SurpriseNet: Anomaly Detection Inspired Class Incremental Learning

AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

Not Just Selection, but Exploration: Online Class-Incremental Continual Learning Via Dual View Consistency