Abstract:Due to the complex internal working process of circulating cooling water systems, most traditional control methods struggle to achieve stable and precise control. Therefore, this paper presents a novel adaptive control structure for the Twin Delayed Deep Deterministic Policy Gradient algorithm, which is based on a reference trajectory model (TD3-RTM). The structure is based on the Markov decision process of the recirculating cooling water system. Initially, the TD3 algorithm is employed to construct a deep reinforcement learning agent. Subsequently, a state space is selected, and a dense reward function is designed, considering the multivariable characteristics of the recirculating cooling water system. The agent updates its network based on different reward values obtained through interactions with the system, thereby gradually aligning the action values with the optimal policy. The TD3-RTM method introduces a reference trajectory model to accelerate the convergence speed of the agent and reduce oscillations and instability in the control system. Subsequently, simulation experiments were conducted in MATLAB/Simulink. The results show that compared to PID, fuzzy PID, DDPG and TD3, the TD3-RTM method improved the transient time in the flow loop by 6.09s, 5.29s, 0.57s, and 0.77s, respectively, and the Integral of Absolute Error(IAE) indexes decreased by 710.54, 335.1, 135.97, and 89.96, respectively, and the transient time in the temperature loop improved by 25.84s, 13.65s, 15.05s, and 0.81s, and the IAE metrics were reduced by 143.9, 59.13, 31.79, and 1.77, respectively. In addition, the overshooting of the TD3-RTM method in the flow loop was reduced by 17.64, 7.79, and 1.29 per cent, respectively, in comparison with the PID, the fuzzy PID, and the TD3.

Optimal Control of Chilled Water System Based on Improved Sparrow Search Algorithm

Performance monitoring and assessment for PID controller

Novel PID Controller Parameters Tuning Method.

Process Control Parameters Optimal Selection Based on Particle Swarm Algorithm

On PID Controllers Based on Simulated Annealing Algorithm

Model reference adaptive control based on particle swarm optimization algorithm

Subcooling Control Method for the Adjustable Ejector in the Direct Expansion Solar Assisted Ejector-Compression Heat Pump Water Heater

Optimal chiller loading by improved sparrow search algorithm for saving energy consumption

Optimum Control Strategy and Performance Simulation of a Constant Temperature and Humidity Air-conditioning System

Economical Design of Drip Irrigation Control System Management Based on the Chaos Beetle Search Algorithm

Chilled Water Temperature Control of HVAC System Using GPC Based Controller

PID Control for Incubator Based on Alternative Chaos Particle Swarm Optimization

Optimization of PID controller for stepper motor speed control system based on improved sparrow search algorithm

OPTIMIZATION OF CIRCULATING WATER SYSTEM IN THERMAL POWER PLANTS BASED ON IMMUNE ALGORITHM

Intelligent PID Controller Design with Adaptive Criterion Adjustment Via Least Squares Support Vector Machine

A Particle Swarm Optimization Approach For Pid Parameters In Hydraulic Servo Control System

Intelligent Water and Fertilizer Control Strategy of Fuzzy PID Optimized by Swarm Intelligence Algorithm

The Optimal Control Strategy for Chilled Water System in Central Air-Conditioning Systems

Study and simulation of the HDB-PID control algorithm

Applications of Improved Least-Squares Algorithm in Main Steam Temperature Control System

Adaptive control for circulating cooling water system using deep reinforcement learning