Abstract:Machine learning approaches have been proven to be effective and efficient in mediating flow dynamics so as to realize drag reduction, vibration suppression, etc. In this article, an intelligent active flow control approach is proposed to enhance heat transfer of a heated circular cylinder at Re=100 undergoing vortex induced vibration in the lock-in condition. A high-fidelity solver based on the generalized interpolation-supplemented lattice Boltzmann method (GILBM) with moving reference frame (MRF) is used to establish the real-time numerical environment with structural motion, momentum transport, and heat transport. A reinforcement learning (RL) agent realized by proximal policy optimization (PPO) is adopted to establish the model-free controller, which receives sensorymotor cues as feedback signals and determines the real-time velocity issued from the jet as actuation. Through a group of trainings, each of whom involves 200 independent cases, the RL agent eventually learns an effective and efficient control strategy that improves the average heat transfer rate by 76.7%, quantified by the dimensionless Nusselt number. Through analyzing the spatiotemporal variations of vorticity and temperature fields, local Nusselt number and pressure coefficient along the cylinder surface, as well as the statistical flow quantities, it is proved that that the enhanced heat transfer is contributed by both the mediated vortex formation and shedding in vicinity of the blowing jet, as well as the augmented vibration. Extra tests also confirm that the synthetic jets play a much more significant role than the augmented vibration. Furthermore, the success of the control strategy is attributed mainly by the phase lag between the maximum vibration displacement and the moment when the synthetic jets oppose their directions. Moreover, the more realistic but more complicated case with the non-Oberbeck-Boussinesq (NOB) approximation is also tested, confirming good self-adaptivity of the learnt strategy. Through this study, it is verified that the RL to be a powerful tool for mediating flows involving complicated momentum and heat transport.

Closed-Loop Turbulence Control-From Human to Machine Learning (and Retour)

Closed-Loop Turbulence Control: Progress and Challenges

Turbulence Control: from Model-Based to Machine Learned

Machine Learning Control - Taming Nonlinear Dynamics and Turbulence Preface

Closed-loop control of experimental shear flows using machine learning

Taming Non-Linear Dynamics and Turbulence with Machine Learning Control.

Closed-loop Control of an Experimental Mixing Layer Using Machine Learning Control

Fast Self-Learning of Turbulence Feedback Laws Using Gradient-Enriched Machine Learning Control.

Turbulence Control Based on Reduced-Order Models and Nonlinear Control Design

An Old-Fashioned Framework for Machine Learning in Turbulence Modeling

Towards human-interpretable, automated learning of feedback control for the mixing layer

Stabilization of a multi-frequency open cavity flow with gradient-enriched machine learning control

Attractor Control Using Machine Learning

Enhancing Heat Transfer from a Circular Cylinder Undergoing Vortex Induced Vibration Based on Reinforcement Learning

Learning-Based Neural Dynamic Surface Predictive Control for MMC

Challenges and Opportunities for Machine Learning in Fluid Mechanics

Machine-learning flow control with few sensor feedback and measurement noise

Closed-loop Separation Control Using Machine Learning

Machine Learning for Fluid Mechanics

Tempestas ex machina: A review of machine learning methods for wavefront control

Recent Progress of Machine Learning in Flow Modeling and Active Flow Control