Abstract:Semi-supervised anomaly detection for sensor signals is critical in ensuring system reliability in smart manufacturing. However, existing methods rely heavily on data correlation, neglecting causality and leading to potential misinterpretations due to confounding factors. Moreover, while current reinforcement learning-based methods can effectively identify known and unknown anomalies with limited labeled samples, these methods still face several challenges, such as under-utilization of priori knowledge, lack of model flexibility, and deficient reward feedback during environmental interactions. To address the above problems, this paper innovatively constructs a counterfactual causal reinforcement learning model, termed Triple-Assisted Causal Reinforcement Learning Anomaly Detector (Tri-CRLAD). The model leverages causal inference to extract the intrinsic causal feature in data, enhancing the agent's utilization of prior knowledge and improving its generalization capability. In addition, Tri-CRLAD features a triple decision support mechanism, including a sampling strategy based on historical similarity, an adaptive threshold smoothing adjustment strategy, and an adaptive decision reward mechanism. These mechanisms further enhance the flexibility and generalization ability of the model, enabling it to effectively respond to various complex and dynamically changing environments. Experimental results across seven diverse sensor signal datasets demonstrate that Tri-CRLAD outperforms nine state-of-the-art baseline methods. Notably, Tri-CRLAD achieves up to a 23\% improvement in anomaly detection stability with minimal known anomaly samples, highlighting its potential in semi-supervised anomaly detection scenarios. Our code is available at

On Root Cause Localization and Anomaly Mitigation through Causal Inference

A Causal Approach to Detecting Multivariate Time-series Anomalies and Root Causes

Root-cause analysis for time-series anomalies via spatiotemporal causal graphical modeling.

On the Fly Detection of Root Causes from Observed Data with Application to IT Systems

CausalRCA: Causal Inference based Precise Fine-grained Root Cause Localization for Microservice Applications

RCInvestigator: Towards Better Investigation of Anomaly Root Causes in Cloud Computing Systems

Interactive Context-Aware Anomaly Detection Guided by User Feedback

Hierarchical Graph Neural Networks for Causal Discovery and Root Cause Localization

Multi-modal Causal Structure Learning and Root Cause Analysis

Semi-supervised Anomaly Detection via Adaptive Reinforcement Learning-Enabled Method with Causal Inference for Sensor Signals

Achieving Counterfactual Fairness for Anomaly Detection

Learning Causal Temporal Relation and Feature Discrimination for Anomaly Detection.

OCRCL: Online Contrastive Learning for Root Cause Localization of Business Incidents

Data-Driven Root-Cause Analysis For Distributed System Anomalies

Causal Inference-Based Root Cause Analysis for Online Service Systems with Intervention Recognition

Prioritized Local Matching Network for Cross-Category Few-Shot Anomaly Detection

Counterfactual-based Root Cause Analysis for Dynamical Systems

Sparse Causality Analysis Approach with Time-varying Parameters for Root Cause Localization of Nonstationary Process

Root Causing Prediction Anomalies Using Explainable AI

Root Cause Analysis of Outliers with Missing Structural Knowledge