Abstract:Prognostics and Health Management (PHM) is an essential requirement for engineering assets. Its processing strategies include modules for the detection, diagnostics and prognostics of known fault conditions. However, during operation, there are always fault conditions that were not anticipated. These events manifest as anomalies and could potentially be catastrophic with the loss of the asset. Anomalies can indicate an impending fault condition, therefore, the automatic identification of anomalies can lead to solving reliability problems that might manifest because of complexities arising from the operating environment and component degradation. Data-driven approaches have gained increasing popularity as a comprehensive anomaly detection method whenever data on nominal and fault conditions is available. However, many supervised learning techniques often face problems whenever models are trained from the limited set of partially labelled anomalies, whilst the rest of the dataset is left unlabelled. An alternative is to use unsupervised learning techniques, that are supposed to obviate stipulating the performance of the anomaly detector. But these still often produce many false positives because of the lack of prior knowledge of true anomalies. Considering this, this article investigates the use of a Reinforcement Learning (RL)-based approach to address the problem of unknown classes of anomalies that might lie beyond the scope of the initially trained model. A Q-learning method is used to exploit the existing data model whilst exploring new classes to improve classification accuracy and optimise decision making. This makes it of significant practical benefit, as anomalies can be unpredictable in form and usually evolve over time. In particular, a deep network-based anomaly detector agent is used to initially learn the action-value function (i.e., the Q-value function) from the limited labelled data. An environment is created for the agent to actively interact not only with the labelled anomalies but also to explore rare and novel unlabelled anomalies that might lie beyond the scope of the initially trained model. A reward function is defined based on the sparse normative content, which stipulates when the agent detects the anomaly state. However, the robustness of this method is still an open question as it simply shifts the anomaly detection responsibility onto the reward function being used. This shows the strong dependence on how the problem state-action space is defined for these methods to perform well.

RI2AP: Robust and Interpretable 2D Anomaly Prediction in Assembly Pipelines

AssemAI: Interpretable Image-Based Anomaly Detection for Manufacturing Pipelines

Machine-Learning and Physics-Based Tool for Anomaly Identification in Propulsion Systems

Anomaly Detection through Transfer Learning in Agriculture and Manufacturing IoT Systems

Anomaly detection for composite manufacturing using AI models

Advanced Anomaly Detection in Manufacturing Processes: Leveraging Feature Value Analysis for Normalizing Anomalous Data

Root Causing Prediction Anomalies Using Explainable AI

Application of advanced machine learning algorithms for anomaly detection and quantitative prediction in protein A chromatography

Score-Based Anomaly Detection for Smart Manufacturing Systems

Real-Time Anomaly Detection and Reactive Planning with Large Language Models

Abnormality Detection and Failure Prediction Using Explainable Bayesian Deep Learning: Methodology and Case Study with Industrial Data

Explainable Anomaly Detection Framework for Maritime Main Engine Sensor Data

Anomaly Detection and Analysis in Nuclear Power Plants

Anomaly Detection and Inter-Sensor Transfer Learning on Smart Manufacturing Datasets

Anomaly detection framework for IoT-enabled appliances using machine learning

Predictive Maintenance: An Autoencoder Anomaly-Based Approach for a 3 DoF Delta Robot

Robust Anomaly Detection for Time-series Data

Reinforcement Learning-based Anomaly Detection for PHM applications

Anomaly Detection for Predictive Maintenance in Industry 4.0- A survey

Anomaly Detection for Early Failure Identification on Automotive Field Data

Robust and Explainable Semi-Supervised Deep Learning Model for Anomaly Detection in Aviation