Abstract:Deep reinforcement learning (DRL) has gradually emerged as an effective and novel method to achieve active flow control with outstanding performance. This paper focuses on exploring the strategy of improving learning efficiency and control performance of a new task using existing control experience. More specifically, the proximal policy optimization algorithm is used to control the flow past a circular cylinder using jets. The DRL controllers trained from the initialized parameter are able to obtain drag reductions of 8%, 18.7%, 18.4%, and 25.2%, at Re = 100, 200, 300, and 1000, respectively, and it takes more episodes to converge for the cases with higher Reynolds number, due to the increased flow complexity. Furthermore, the agent trained at high Reynolds number shows satisfied control performance when it is applied to the lower Reynolds number cases, which proves a strong correlation between the control policy and the flow patterns between the flows under different conditions. To better utilize the experience of the control policy of the trained agent, the flow control tasks with Re = 200, 300, and 1000 are retrained, based on the trained agent at Re = 100, 200, and 300, respectively. Our results show that a dramatic enhancement of the learning efficiency can be achieved; that is, the number of the training episodes reduces to be less than 20% of the agents trained with random initialization. Moreover, for each flow condition drag reduction approaches a significant level of 20.9%, 27.7%, and 36.1%, respectively. The great performance of the transfer training method of the DRL agent shows its potential on economizing the training cost and improving control effectiveness, especially for complex control tasks.

Deep Reinforcement Learning-Based Active Control for Drag Reduction of Three Equilateral-Triangular Circular Cylinders

Deep reinforcement learning-based active flow control of an elliptical cylinder: transitioning from an elliptical cylinder to a circular cylinder and a flat plate

Deep Reinforcement Learning for Active Control of Flow over a Circular Cylinder with Rotational Oscillations

Deep Reinforcement Learning for Active Flow Control around a Circular Cylinder Using Unsteady-mode Plasma Actuators

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

Drag Reduction in Flows Past 2D and 3D Circular Cylinders Through Deep Reinforcement Learning

Robust and Adaptive Deep Reinforcement Learning for Enhancing Flow Control around a Square Cylinder with Varying Reynolds Numbers

Aerodynamic force reduction of rectangular cylinder using deep reinforcement learning-controlled multiple jets

Deep reinforcement transfer learning for active flow control of a 3D square cylinder under state dimension mismatch

Learning in two dimensions and controlling in three: Generalizable drag reduction strategies for flows past circular cylinders through deep reinforcement learning

Towards Active Flow Control Strategies Through Deep Reinforcement Learning

Surrogate model-based deep reinforcement learning for experimental study of active flow control of circular cylinder

Active flow control for three-dimensional cylinders through deep reinforcement learning

Accelerating and improving deep reinforcement learning-based active flow control: Transfer training of policy network

Deep reinforcement learning for turbulent drag reduction in channel flows

Optimizing Flow Control with Deep Reinforcement Learning: Plasma Actuator Placement around a Square Cylinder

Active Control of Flow over Rotating Cylinder by Multiple Jets using Deep Reinforcement Learning

Active flow control for drag reduction through multi-agent reinforcement learning on a turbulent cylinder at $Re_D=3900$

Deep reinforcement learning-based active flow control of vortex-induced vibration of a square cylinder

Active flow control with rotating cylinders by an artificial neural network trained by deep reinforcement learning

Mitigating the lift of a circular cylinder in wake flow using deep reinforcement learning guided self-rotation