Abstract:Machine learning approaches have been proven to be effective and efficient in mediating flow dynamics so as to realize drag reduction, vibration suppression, etc. In this article, an intelligent active flow control approach is proposed to enhance heat transfer of a heated circular cylinder at Re=100 undergoing vortex induced vibration in the lock-in condition. A high-fidelity solver based on the generalized interpolation-supplemented lattice Boltzmann method (GILBM) with moving reference frame (MRF) is used to establish the real-time numerical environment with structural motion, momentum transport, and heat transport. A reinforcement learning (RL) agent realized by proximal policy optimization (PPO) is adopted to establish the model-free controller, which receives sensorymotor cues as feedback signals and determines the real-time velocity issued from the jet as actuation. Through a group of trainings, each of whom involves 200 independent cases, the RL agent eventually learns an effective and efficient control strategy that improves the average heat transfer rate by 76.7%, quantified by the dimensionless Nusselt number. Through analyzing the spatiotemporal variations of vorticity and temperature fields, local Nusselt number and pressure coefficient along the cylinder surface, as well as the statistical flow quantities, it is proved that that the enhanced heat transfer is contributed by both the mediated vortex formation and shedding in vicinity of the blowing jet, as well as the augmented vibration. Extra tests also confirm that the synthetic jets play a much more significant role than the augmented vibration. Furthermore, the success of the control strategy is attributed mainly by the phase lag between the maximum vibration displacement and the moment when the synthetic jets oppose their directions. Moreover, the more realistic but more complicated case with the non-Oberbeck-Boussinesq (NOB) approximation is also tested, confirming good self-adaptivity of the learnt strategy. Through this study, it is verified that the RL to be a powerful tool for mediating flows involving complicated momentum and heat transport.

Closed-loop forced heat convection control using deep reinforcement learning

Close d-loop force d heat convection control using deep reinforcement learning

Control policy transfer of deep reinforcement learning based intelligent forced heat convection control

A Reinforcement Learning-Based Temperature Control of Fluidized Bed Reactor in Gas-Phase Polyethylene Process

Performance analysis of reinforcement learning algorithms on intelligent closed-loop control on fluid flow and convective heat transfer

Forced Convection Heat Transfer Control for Cylinder Via Closed-Loop Continuous Goal-Oriented Reinforcement Learning

Deep Reinforcement Learning for the Heat Transfer Control of Pulsating Impinging Jets

Applying Deep Reinforcement Learning To Active Flow Control In Weakly Turbulent Conditions

Enhancing Heat Transfer from a Circular Cylinder Undergoing Vortex Induced Vibration Based on Reinforcement Learning

Deep Reinforcement Learning-Pid Based Supervisor Control Method for Indirect-Contact Heat Transfer Processes in Energy Systems

Deep Reinforcement Learning Finds a New Strategy for Vortex-Induced Vibration Control

Controlling Rayleigh–Bénard convection via reinforcement learning

Control of Superheat of Organic Rankine Cycle under Transient Heat Source Based on Deep Reinforcement Learning

A Knowledge-based Reinforcement Learning Control Approach Using Deep Q Network for Cooling Tower in HVAC Systems

Deep Reinforcement Learning: A New Beacon for Intelligent Active Flow Control

Cross temporal-spatial transferability investigation of deep reinforcement learning control strategy in the building HVAC system level

Single-step deep reinforcement learning for open-loop control of laminar and turbulent flows

Effective control of two-dimensional Rayleigh--Bénard convection: invariant multi-agent reinforcement learning is all you need

The Application of DQN in Thermal Process Control

Indoor Temperature Control of Radiant Ceiling Cooling System Based on Deep Reinforcement Learning Method

DRLinFluids---An open-source python platform of coupling Deep Reinforcement Learning and OpenFOAM