Abstract:Reinforcement learning is applied to the development of control strategies in order to reduce skin friction drag in a fully developed turbulent channel flow at a low Reynolds number. Motivated by the so-called opposition control (Choi et al. 1993), in which a control input is applied so as to cancel the wall-normal velocity fluctuation on a detection plane at a certain distance from the wall, we consider wall blowing and suction as a control input, and its spatial distribution is determined by the instantaneous streamwise and wall-normal velocity fluctuations at the distance of 15 wall units above the wall. Deep neural network is used to express the complex relationship between the sensing information and the control input, and it is trained so as to maximize the expected long-term reward, i.e., drag reduction. When only the wall-normal velocity fluctuation is measured and a linear network is used, the present framework successfully reproduces the optimal linear weight for the opposition control reported in the previous study (Chung & Talha 2011). In contrast, when a non-linear network is used, more complex control strategies based on the instantaneous streamwise and wall-normal velocity fluctuations are obtained. Specifically, the obtained control strategies abruptly switch between strong wall blowing and suction for downwelling of a high-speed fluid toward the wall and upwelling of a low-speed fluid away from the wall, respectively. The obtained control policies lead to drag reduction rates as high as 37 %, which is higher than 23 % achieved by the conventional opposition control at the same Reynolds number. The present results indicate that reinforcement learning can be a novel framework for the development of effective control strategies through systematic learning based on a large number of trials.

Reinforcement Learning of Control Strategies for Reducing Skin Friction Drag in a Fully Developed Channel Flow

Deep reinforcement learning for turbulent drag reduction in channel flows

Drag Reduction Via Turbulent Boundary Layer Flow Control

Drag-reduction strategies in wall-bounded turbulent flows using deep reinforcement learning

A combined active control method of restricted nonlinear model and machine learning technology for drag reduction in turbulent channel flow

Strengthened Opposition Control for Skin-Friction Reduction in Wall-Bounded Turbulent Flows

Active control for drag reduction of turbulent channel flow based on convolutional neural networks

Opposition flow control for reducing skin-friction drag of a turbulent boundary layer

Blowing-only Opposition Control: Characteristics of Turbulent Drag Reduction and Implementation by Deep Learning

Active Control for Drag Reduction in Turbulent Channel Flow: the Opposition Control Schemes Revisited

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

Active flow control for bluff body drag reduction using reinforcement learning with partial measurements

Artificial Neural Networks trained through Deep Reinforcement Learning discover control strategies for active flow control

Reducing the Drag of a Bluff Body by Deep Reinforcement Learning

Learning in two dimensions and controlling in three: Generalizable drag reduction strategies for flows past circular cylinders through deep reinforcement learning

Drag Reduction of Blowing-Based Active Control in a Turbulent Boundary Layer

Active flow control with rotating cylinders by an artificial neural network trained by deep reinforcement learning

Deep Reinforcement Learning for Active Control of Flow over a Circular Cylinder with Rotational Oscillations

Direct numerical simulation of spatially developing turbulent boundary layers with opposition control