Abstract:The operation of a wastewater treatment plant (WWTP) is a typical complex control problem, with nonlinear dynamics and coupling effects among the variables, which renders the implementation of real-time optimal control an enormous challenge. In this study, a Q-learning algorithm with activated sludge model No. 2d-guided (ASM2d-guided) reward setting (an integrated ASM2d-QL algorithm) is proposed, and the widely applied anaerobic-anoxic-oxic (AAO) system is chosen as the research paradigm. The integrated ASM2d-QL algorithms equipped with a self-learning mechanism are derived for optimizing the control strategies (hydraulic retention time (HRT) and internal recycling ratio (IRR)) of the AAO system. To optimize the control strategies of the AAO system under varying influent loads, Q matrixes were built for both HRTs and IRR optimization through the pair of <max reward-action> based on the integrated ASM2d-QL algorithm. 8 days of actual influent qualities of a certain municipal AAO wastewater treatment plant in June were arbitrarily chosen as the influent concentrations for model verification. Good agreement between the values of the model simulations and experimental results indicated that this proposed integrated ASM2d-QL algorithm performed properly and successfully realized intelligent modeling and stable optimal control strategies under fluctuating influent loads during wastewater treatment.

Online Sequential Extreme Learning Machine Based Adaptive Control for Wastewater Treatment Plant

Prediction Based on Online Extreme Learning Machine in WWTP Application

Fuzzy Adaptive Generalized Predictive Control for Wastewater Treatment Process

A Multi-Objective Direct Heuristic Dynamic Programming Based Tracking Control for Wastewater Treatment Process

Data-Driven Robust Adaptive Control with Deep Learning for Wastewater Treatment Process

Reinforcement-Learning-Based Tracking Control of Waste Water Treatment Process under Realistic System Conditions and Control Performance Requirements

Event-Driven Model Predictive Control with Deep Learning for Wastewater Treatment Process

Data-driven Robust Adaptive Control for Wastewater Treatment Process

Design of Online ESN-ADP for Dissolved Oxygen Control in WWTP.

Adaptive Control of Nonlinear System Using Online Error Minimum Neural Networks.

Adaptive Control of Nonlinear Discrete-Time Systems by Using OS-ELM Neural Networks

Adaptive Fuzzy Neural Network Control of Wastewater Treatment Process with Multiobjective Operation.

Nonlinear Model-Predictive Control for Industrial Processes: an Application to Wastewater Treatment Process

Data-Driven Iterative Adaptive Critic Control Toward an Urban Wastewater Treatment Plant

Online Adaptive Dynamic Programming Based on Echo State Networks for Dissolved Oxygen Control.

A Real-Time BOD Estimation Method in Wastewater Treatment Process Based on an Optimized Extreme Learning Machine

Optimal control for wastewater treatment process based on ESN neural network

Adaptive critic design with weight allocation for intelligent learning control of wastewater treatment plants

A Neural Network Predictive Control System for Paper Mill Wastewater Treatment

Fuzzy Neural Network-Based Adaptive Asymmetric Constraint Control in Wastewater Treatment Process.

Intelligent Control/Operational Strategies in WWTPs through an Integrated Q-Learning Algorithm with ASM2d-Guided Reward