Abstract:Abstract In the development of the international nuclear power industry, nuclear energy safety has always been an unavoidable major issue, and nuclear energy safety concerns global energy development, public safety and national security. In the process of variable operating conditions of the thermal engineering system, incorrect alarm information may appear in the main control room due to the fluctuations of the system operation, which hinders the judgment of the actual operating state of the thermal engineering system. Although some research work has been carried out in the field of thermal system condition recognition in the world, the relevant research often adopts unsupervised machine learning model or supervised neural network model, and the application of deep reinforcement learning method is rarely studied. The deep reinforcement learning model can interact in real time in the environment, and multiple neural network models inside the deep reinforcement learning model can be trained through the guidance of the designed reward function to output different result values that can better complete the task based on different data. This method often has strong dynamic programming characteristics. It has strong theoretical feasibility in dynamic adjustment of spatial coding of thermal system data. Therefore, by combining the Convolutional Auto-Encode (CAE) method in the auto-encoder and the Double Deep Q-learning (DDQN) method in the deep reinforcement learning, this research constructs an intelligent model for the recognition of abnormal working conditions of thermal systems under time series. This research takes the simulation data of Qinshan Nuclear Power Plant under varying working conditions as the data sources, and compiles the spatial encoding of the time series data through the Convolutional Auto-Encode (CAE) model, which is pre-trained. Take the constructed spatial coding as the state value of the Double Deep Q-learning (DDQN) model, and guide the Double Deep Q-learning (DDQN) model to adjust the state of spatial coding through appropriate reward value. Finally, the ideal test results are obtained. By comparing with traditional anomaly detection methods, it is proved that CAE-DDQN model has a very ideal condition recognition effect, and the recognition effect of difficult to identify data and very early accident data is much stronger than that of traditional machine learning or deep learning methods. At the same time, it is proved that the deep reinforcement learning method based on the principle of Q function is feasible in the condition recognition of thermal engineering system.

System-level Anomaly Detection for Nuclear Power Plants Using Variational Graph Auto-encoders

Robust and Unsupervised KPI Anomaly Detection Based on Highly Sensitive Conditional Variational Auto-Encoders.

Self-Supervised Variational Graph Autoencoder for System-Level Anomaly Detection

Research on anomaly detection method of nuclear power plant operation state based on unsupervised deep generative model

An Anomaly Detection Algorithm for the Power Industrial Terminal Security Monitoring

The Study on Multivariate Time Series Anomaly Detection Via Convolutional Variational Autoencoder

Spatial-Temporal Graph Conditionalized Normalizing Flows for Nuclear Power Plant Multivariate Anomaly Detection

Anomaly Detection of Power Plant Equipment Using Long Short-Term Memory Based Autoencoder Neural Network

Attention-based time series analysis for data-driven anomaly detection in nuclear power plants

Development of an Ai-Based Predictive Anomaly Detection System to Nuclear Power Plant

A model fine-tuning approach for robust anomaly detection and isolation in multi-sensor system of nuclear power plants

Real-time Nuclear Power Plant Monitoring with Neural Network

Uncertainty‐aware Nuclear Power Turbine Vibration Fault Diagnosis Method Integrating Machine Learning and Heuristic Algorithm

Anomaly Detection of Thermal System Using CAE-DDQN Model

Anomaly Detection Based on Regularized Vector Auto Regression in Thermal Power Plant

Abnormal Event Detection in Nuclear Power Plants via Attention Networks

Anomaly Detection for Asynchronous Multivariate Time Series of Nuclear Power Plants Using a Temporal-Spatial Transformer

Steam Turbine Anomaly Detection: An Unsupervised Learning Approach Using Enhanced Long Short-Term Memory Variational Autoencoder

Multi-mode non-Gaussian variational autoencoder network with missing sources for anomaly detection of complex electromechanical equipment

Few-Shot Learning for Abnormal Event Detection in Nuclear Power Plants

ANOMALY DETECTION FOR NETWORK TRAFFIC OF I&C SYSTEMS BASED ON NEURAL NETWORK