Abstract:<p>Urban wastewater sector is being pushed to optimize processes in order to reduce energy consumption without compromising its quality standards. Energy costs can represent a significant share of the global operational costs (between 50% and 60%) in an intensive energy consumer. Pumping is the largest consumer of electrical energy in a wastewater treatment plant. Thus, the optimal control of pump units can help the utilities to decrease operational costs. This work describes an innovative predictive control policy for wastewater variable-frequency pumps that minimize electrical energy consumption, considering uncertainty forecasts for wastewater intake rate and information collected by sensors accessible through the Supervisory Control and Data Acquisition system. The proposed control method combines statistical learning (regression and predictive models) and deep reinforcement learning (Proximal Policy Optimization). The following main original contributions are produced: (i) model-free and data-driven predictive control; (ii) control philosophy focused on operating the tank with a variable wastewater set-point level; (iii) use of supervised learning to generate synthetic data for pre-training the reinforcement learning policy, without the need to physically interact with the system. The results for a real case-study during 90 days show a 16.7% decrease in electrical energy consumption while still achieving a 97% reduction in the number of alarms (tank level above 7.2 m) when compared with the current operating scenario (operating with a fixed set-point level). The numerical analysis showed that the proposed data-driven method is able to explore the trade-off between number of alarms and consumption minimization, offering different options to decision-makers.</p>

Data-Based Robust Adaptive Dynamic Programming for Balancing Control Performance and Energy Consumption in Wastewater Treatment Process

A Multi-Objective Direct Heuristic Dynamic Programming Based Tracking Control for Wastewater Treatment Process

Policy Gradient Adaptive Critic Design With Dynamic Prioritized Experience Replay for Wastewater Treatment Process Control

Adaptive Optimal Control for A Wastewater Treatment Plant Based on A Data-Driven Method

Data-driven Robust Adaptive Control for Wastewater Treatment Process

Data-Driven Robust Adaptive Control with Deep Learning for Wastewater Treatment Process

Reinforcement-Learning-Based Tracking Control of Waste Water Treatment Process under Realistic System Conditions and Control Performance Requirements

Online Sequential Extreme Learning Machine Based Adaptive Control for Wastewater Treatment Plant

Dynamic multi-objective optimization control for wastewater treatment process based on modal decomposition and hybrid neural network

Supplementary heuristic dynamic programming for wastewater treatment process control

Data-Based Predictive Control for Wastewater Treatment Process

Data-driven predictive energy optimization in a wastewater pumping station

Data-driven minimization of pump operating and maintenance cost.

Adaptive Fuzzy Neural Network Control of Wastewater Treatment Process with Multiobjective Operation.

Neural Network Optimal Control for Wastewater Treatment Process Based on APSO

A Hybrid Intelligent Optimal Control System Design for Wastewater Treatment Process

Neural Network-Based Adaptive Tracking Control for Denitrification and Aeration Processes With Time Delays

Action-Dependent Heuristic Dynamic Programming With Experience Replay for Wastewater Treatment Processes

Adaptive critic design with weight allocation for intelligent learning control of wastewater treatment plants

Double Closed Loop Robust Optimal Control for Wastewater Treatment Process