Abstract:Noise generated by vortices is a sensible measure of the strength of wakes generated in a flow field. This paper presents an innovative approach to actively control wakes and noise generated in a flow past a cylinder using deep reinforcement learning (DRL) as a continuously learning active control algorithm with noise levels recorded using acoustic level around the wake region. The two primary objectives of this study is to investigate the feasibility and effectiveness of use of acoustic level as controlling parameter and employing DRL algorithms to optimize the control of flow dynamics. A hydrophone array is utilised to capture the wake pattern along the flow field downstream of a circular cylinder in the form of acoustic signals. The collected data are used to create a real-time feedback loop for a DRL agent to adjust jet actuators strategically placed on the cylinder's surface. This approach enables the agent to learn and adapt its control strategy based on the observed acoustic feedback, resulting in a closed-loop control system. We demonstrate that the DRL-based flow control strategy can effectively reduce wake amplitude and the noise generated. The noise level reduces by an appreciable 6.9\% and 9.5\% in the given setting for two control configurations. Similarly, the drag coefficient reduces by a remarkable 15.9\% and 23.8\% respectively. Specifically, it reduces the oscillation amplitude in drag and noise. The proposed method offers promising results in terms of reducing flow-induced vibration. The paper highlights the potential for using DRL, jets, and hydrophone arrays in active flow control, opening new avenues for optimizing flow control in practical engineering applications.

Deep reinforcement learning-based active flow control of vortex-induced vibration of a square cylinder

From Active Learning to Deep Reinforcement Learning: Intelligent Active Flow Control in Suppressing Vortex-Induced Vibration

Robust and Adaptive Deep Reinforcement Learning for Enhancing Flow Control around a Square Cylinder with Varying Reynolds Numbers

System Identification and Model Predictive Control of Vortex Shedding Behind a Rotating Cylinder

Effect of Synthetic Jets Actuator Parameters on Deep Reinforcement Learning-Based Flow Control Performance in a Square Cylinder

Deep Reinforcement Learning for Active Flow Control around a Circular Cylinder Using Unsteady-mode Plasma Actuators

Acoustics-based Active Control of Unsteady Flow Dynamics using Reinforcement Learning Driven Synthetic Jets

Active control for enhancing vortex induced vibration of a circular cylinder based on deep reinforcement learning

Deep reinforcement learning-based active flow control of an elliptical cylinder: transitioning from an elliptical cylinder to a circular cylinder and a flat plate

Optimizing Flow Control with Deep Reinforcement Learning: Plasma Actuator Placement around a Square Cylinder

Active flow control with rotating cylinders by an artificial neural network trained by deep reinforcement learning

Deep reinforcement transfer learning for active flow control of a 3D square cylinder under state dimension mismatch

Active Control of Flow over Rotating Cylinder by Multiple Jets using Deep Reinforcement Learning

Deep reinforcement learning based synthetic jet control on disturbed flow over airfoil

Deep Reinforcement Learning for Active Control of Flow over a Circular Cylinder with Rotational Oscillations

Active flow control for three-dimensional cylinders through deep reinforcement learning

Aerodynamic force reduction of rectangular cylinder using deep reinforcement learning-controlled multiple jets

Active flow control for drag reduction through multi-agent reinforcement learning on a turbulent cylinder at $Re_D=3900$

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

Towards Active Flow Control Strategies Through Deep Reinforcement Learning

Efficient Active Flow Control Strategy for Confined Square Cylinder Wake Using Deep Learning-Based Surrogate Model and Reinforcement Learning