Abstract:Deep reinforcement learning (DRL) has gradually emerged as an effective and novel method to achieve active flow control with outstanding performance. This paper focuses on exploring the strategy of improving learning efficiency and control performance of a new task using existing control experience. More specifically, the proximal policy optimization algorithm is used to control the flow past a circular cylinder using jets. The DRL controllers trained from the initialized parameter are able to obtain drag reductions of 8%, 18.7%, 18.4%, and 25.2%, at Re = 100, 200, 300, and 1000, respectively, and it takes more episodes to converge for the cases with higher Reynolds number, due to the increased flow complexity. Furthermore, the agent trained at high Reynolds number shows satisfied control performance when it is applied to the lower Reynolds number cases, which proves a strong correlation between the control policy and the flow patterns between the flows under different conditions. To better utilize the experience of the control policy of the trained agent, the flow control tasks with Re = 200, 300, and 1000 are retrained, based on the trained agent at Re = 100, 200, and 300, respectively. Our results show that a dramatic enhancement of the learning efficiency can be achieved; that is, the number of the training episodes reduces to be less than 20% of the agents trained with random initialization. Moreover, for each flow condition drag reduction approaches a significant level of 20.9%, 27.7%, and 36.1%, respectively. The great performance of the transfer training method of the DRL agent shows its potential on economizing the training cost and improving control effectiveness, especially for complex control tasks.

A field programmable gate array-based deep reinforcement learning framework for experimental active flow control and its application in airfoil flow separation elimination

Deep reinforcement learning based synthetic jet control on disturbed flow over airfoil

Optimal parallelization strategies for active flow control in deep reinforcement learning-based computational fluid dynamics

Robust and Adaptive Deep Reinforcement Learning for Enhancing Flow Control around a Square Cylinder with Varying Reynolds Numbers

Deep Reinforcement Learning for Active Flow Control around a Circular Cylinder Using Unsteady-mode Plasma Actuators

Towards Active Flow Control Strategies Through Deep Reinforcement Learning

Experimental Control of the Flow Separation Behind a Backward Facing Step Using Deep Reinforcement Learning

Closed-loop Flow Control Method Based on Deep Reinforcement Learning using a Co-flow Jet

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

Deep Reinforcement Learning: A New Beacon for Intelligent Active Flow Control

Accelerating Deep Reinforcement Learning strategies of Flow Control through a multi-environment approach

Optimizing Flow Control with Deep Reinforcement Learning: Plasma Actuator Placement around a Square Cylinder

Robust active flow control over a range of Reynolds numbers using an artificial neural network trained through deep reinforcement learning

Experimental study on Q-learning control of airfoil trailing-edge flow separation using plasma synthetic jets

Accelerating and improving deep reinforcement learning-based active flow control: Transfer training of policy network

Deep reinforcement learning for propulsive performance of a flapping foil

Active flow control with rotating cylinders by an artificial neural network trained by deep reinforcement learning

Learn to Flap: Foil Non-parametric Path Planning via Deep Reinforcement Learning

Adaptive control of transonic buffet and buffeting flow with deep reinforcement learning

Reinforcement Learning for Active Flow Control in Experiments