Abstract:Wastewater treatment plants (WWTPs) are designed to eliminate pollutants and alleviate environmental pollution resulting from human activities. However, the construction and operation of WWTPs consume resources, emit greenhouse gases (GHGs) and produce residual sludge, thus require further optimization. WWTPs are complex to control and optimize because of high non-linearity and variation. This study used a novel technique, multi-agent deep reinforcement learning (MADRL), to simultaneously optimize dissolved oxygen (DO) and chemical dosage in a WWTP. The reward function was specially designed from life cycle perspective to achieve sustainable optimization. Five scenarios were considered: baseline, three different effluent quality and cost-oriented scenarios. The result shows that optimization based on LCA has lower environmental impacts compared to baseline scenario, as cost, energy consumption and greenhouse gas emissions reduce to 0.890 CNY/m3-ww, 0.530 kWh/m3-ww, 2.491 kg CO2-eq/m3-ww respectively. The cost-oriented control strategy exhibits comparable overall performance to the LCA-driven strategy since it sacrifices environmental benefits but has lower cost as 0.873 CNY/m3-ww. It is worth mentioning that the retrofitting of WWTPs based on resources should be implemented with the consideration of impact transfer. Specifically, LCA-SW scenario decreases 10 kg PO4-eq in eutrophication potential compared to the baseline within 10 days, while significantly increases other indicators. The major contributors of each indicator are identified for future study and improvement. Last, the authors discussed that novel dynamic control strategies required advanced sensors or a large amount of data, so the selection of control strategies should also consider economic and ecological conditions. In a nutshell, there are still limitations of this work and future studies are required.

Development of AI-based process controller of sour water treatment unit using deep reinforcement learning

Accelerating Reinforcement Learning with Local Data Enhancement for Process Control

A Reinforcement Learning-Based Temperature Control of Fluidized Bed Reactor in Gas-Phase Polyethylene Process

Interval Weight State Update Approach with Deep Reinforcement Learning for Dynamic Load Change Tasks in Air Separation Processes

Reinforcement-Learning-Based Tracking Control of Waste Water Treatment Process under Realistic System Conditions and Control Performance Requirements

Intelligent Control/Operational Strategies in WWTPs through an Integrated Q-Learning Algorithm with ASM2d-Guided Reward

Accelerating reinforcement learning with case-based model-assisted experience augmentation for process control

Optimization of Operation Parameters Towards Sustainable WWTP Based on Deep Reinforcement Learning.

Deep Learning Based Simulators for the Phosphorus Removal Process Control in Wastewater Treatment via Deep Reinforcement Learning Algorithms

Application of Soft Actor-Critic Algorithms in Optimizing Wastewater Treatment with Time Delays Integration

Optimizing Irrigation Efficiency using Deep Reinforcement Learning in the Field

Optimizing olefin purification: An artificial intelligence-based process-conscious PI controller tuning for double dividing wall column distillation

Intelligent Control of Wastewater Treatment Plants Based on Model-Free Deep Reinforcement Learning

Ai-based optimal control of fed-batch biopharmaceutical process leveraging deep reinforcement learning

Dissolved oxygen concentration control in wastewater treatment process based on reinforcement learning

A Deep Reinforcement Learning Approach to Improve the Learning Performance in Process Control

Cooling Water System Control of a Commercial Complex Based on Reinforcement Learning

Optimal control towards sustainable wastewater treatment plants based on multi-agent reinforcement learning

Adaptive control for circulating cooling water system using deep reinforcement learning