Abstract:Machine learning approaches have been proven to be effective and efficient in mediating flow dynamics so as to realize drag reduction, vibration suppression, etc. In this article, an intelligent active flow control approach is proposed to enhance heat transfer of a heated circular cylinder at Re=100 undergoing vortex induced vibration in the lock-in condition. A high-fidelity solver based on the generalized interpolation-supplemented lattice Boltzmann method (GILBM) with moving reference frame (MRF) is used to establish the real-time numerical environment with structural motion, momentum transport, and heat transport. A reinforcement learning (RL) agent realized by proximal policy optimization (PPO) is adopted to establish the model-free controller, which receives sensorymotor cues as feedback signals and determines the real-time velocity issued from the jet as actuation. Through a group of trainings, each of whom involves 200 independent cases, the RL agent eventually learns an effective and efficient control strategy that improves the average heat transfer rate by 76.7%, quantified by the dimensionless Nusselt number. Through analyzing the spatiotemporal variations of vorticity and temperature fields, local Nusselt number and pressure coefficient along the cylinder surface, as well as the statistical flow quantities, it is proved that that the enhanced heat transfer is contributed by both the mediated vortex formation and shedding in vicinity of the blowing jet, as well as the augmented vibration. Extra tests also confirm that the synthetic jets play a much more significant role than the augmented vibration. Furthermore, the success of the control strategy is attributed mainly by the phase lag between the maximum vibration displacement and the moment when the synthetic jets oppose their directions. Moreover, the more realistic but more complicated case with the non-Oberbeck-Boussinesq (NOB) approximation is also tested, confirming good self-adaptivity of the learnt strategy. Through this study, it is verified that the RL to be a powerful tool for mediating flows involving complicated momentum and heat transport.

Deep reinforcement learning of airfoil pitch control in a highly disturbed environment using partial observations

Deep reinforcement learning of airfoil pitch control in a highly disturbed environment using partial observations

Applying Deep Reinforcement Learning To Active Flow Control In Weakly Turbulent Conditions

Model-Based Reinforcement Learning for Control of Strongly-Disturbed Unsteady Aerodynamic Flows

Deep Reinforcement Learning Finds a New Strategy for Vortex-Induced Vibration Control

Deep reinforcement learning based synthetic jet control on disturbed flow over airfoil

Deep reinforcement learning for turbulent drag reduction in channel flows

Adaptive control of transonic buffet and buffeting flow with deep reinforcement learning

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

A field programmable gate array-based deep reinforcement learning framework for experimental active flow control and its application in airfoil flow separation elimination

Active Flow Control for Bluff Body Drag Reduction Using Reinforcement Learning with Partial Measurements

Active Flow Control Using Deep Reinforcement Learning with Time Delays in Markov Decision Process and Autoregressive Policy

Robust and Adaptive Deep Reinforcement Learning for Enhancing Flow Control around a Square Cylinder with Varying Reynolds Numbers

Enhancing Heat Transfer from a Circular Cylinder Undergoing Vortex Induced Vibration Based on Reinforcement Learning

Single-step deep reinforcement learning for open-loop control of laminar and turbulent flows

Active Control of Wake-Induced Vibration Using Deep Reinforcement Learning

Active Flow Control for Bluff Body under High Reynolds Number Turbulent Flow Conditions Using Deep Reinforcement Learning

Acoustics-based Active Control of Unsteady Flow Dynamics using Reinforcement Learning Driven Synthetic Jets

Deep Reinforcement Learning for Active Flow Control around a Circular Cylinder Using Unsteady-mode Plasma Actuators

Data-Driven Aircraft Modeling for Robust RL Control Synthesis with Flight Test Validation