Abstract:We develop neural-network active flow controllers using a deep learning partial differential equation augmentation method (DPM). The end-to-end sensitivities for optimization are computed using adjoints of the governing equations without restriction on the terms that may appear in the objective function. In one-dimensional Burgers' examples with analytic (manufactured) control functions, DPM-based control is comparably effective to standard supervised learning for in-sample solutions and more effective for out-of-sample solutions, i.e., with different analytic control functions. The influence of the optimization time interval and neutral-network width is analyzed, the results of which influence algorithm design and hyperparameter choice, balancing control efficacy with computational cost. We subsequently develop adjoint-based controllers for two flow scenarios. First, we compare the drag-reduction performance and optimization cost of adjoint-based controllers and deep reinforcement learning (DRL) -based controllers for two-dimensional, incompressible, confined flow over a cylinder at Re=100 , with control achieved by synthetic body forces along the cylinder boundary. The required model complexity for the DRL-based controller is 4229 times that required for the DPM-based controller. In these tests, the DPM-based controller is 4.85 times more effective and 63.2 times less computationally intensive to train than the DRL-based controller. Second, we test DPM-based control for compressible, unconfined flow over a cylinder and extrapolate the controller to out-of-sample Reynolds numbers. We also train a simplified, steady, offline controller based on the DPM control law. Both online (DPM) and offline (steady) controllers stabilize the vortex shedding with a 99% drag reduction, demonstrating the robustness of the learning approach. For out-of-sample flows ( Re={50,200,300,400} ), both the online and offline controllers successfully reduce drag and stabilize vortex shedding, indicating that the DPM-based approach results in a stable model. A key attractive feature is the flexibility of adjoint-based optimization, which permits optimization over arbitrarily defined control laws without the need to match a priori known functions. https://doi.org/10.1103/PhysRevFluids.9.013901 ©2024 American Physical Society

Reinforcement learning strategies for closed-loop control in fluid dynamics

Single-step deep reinforcement learning for open-loop control of laminar and turbulent flows

Applying Deep Reinforcement Learning To Active Flow Control In Weakly Turbulent Conditions

Deep reinforcement learning for turbulent drag reduction in channel flows

Deep Reinforcement Learning Finds a New Strategy for Vortex-Induced Vibration Control

Drag-reduction strategies in wall-bounded turbulent flows using deep reinforcement learning

Artificially Intelligent Control of Drag Reduction Around a Circular Cylinder Based on Wall Pressure Feedback

Enhancing Heat Transfer from a Circular Cylinder Undergoing Vortex Induced Vibration Based on Reinforcement Learning

Model-Based Reinforcement Learning for Control of Strongly-Disturbed Unsteady Aerodynamic Flows

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

Learning in two dimensions and controlling in three: Generalizable drag reduction strategies for flows past circular cylinders through deep reinforcement learning

Deep Reinforcement Learning: A New Beacon for Intelligent Active Flow Control

Deep model predictive flow control with limited sensor data and online learning

Deep Dynamical Modeling and Control of Unsteady Fluid Flows

Deep Reinforcement Learning for Active Control of Flow over a Circular Cylinder with Rotational Oscillations

Towards Active Flow Control Strategies Through Deep Reinforcement Learning

Artificial Neural Networks trained through Deep Reinforcement Learning discover control strategies for active flow control

Deep reinforcement learning in fluid mechanics: A promising method for both active flow control and shape optimization

Machine-learning flow control with few sensor feedback and measurement noise

Reinforcement Learning for Bluff Body Active Flow Control in Experiments and Simulations

Adjoint-based machine learning for active flow control