Abstract:Noise generated by vortices is a sensible measure of the strength of wakes generated in a flow field. This paper presents an innovative approach to actively control wakes and noise generated in a flow past a cylinder using deep reinforcement learning (DRL) as a continuously learning active control algorithm with noise levels recorded using acoustic level around the wake region. The two primary objectives of this study is to investigate the feasibility and effectiveness of use of acoustic level as controlling parameter and employing DRL algorithms to optimize the control of flow dynamics. A hydrophone array is utilised to capture the wake pattern along the flow field downstream of a circular cylinder in the form of acoustic signals. The collected data are used to create a real-time feedback loop for a DRL agent to adjust jet actuators strategically placed on the cylinder's surface. This approach enables the agent to learn and adapt its control strategy based on the observed acoustic feedback, resulting in a closed-loop control system. We demonstrate that the DRL-based flow control strategy can effectively reduce wake amplitude and the noise generated. The noise level reduces by an appreciable 6.9\% and 9.5\% in the given setting for two control configurations. Similarly, the drag coefficient reduces by a remarkable 15.9\% and 23.8\% respectively. Specifically, it reduces the oscillation amplitude in drag and noise. The proposed method offers promising results in terms of reducing flow-induced vibration. The paper highlights the potential for using DRL, jets, and hydrophone arrays in active flow control, opening new avenues for optimizing flow control in practical engineering applications.

Reinforcement Learning for Active Noise Control in a Hydraulic System

Adaptive Robust Control Of Variable Displacement Pumps

Dynamic Impact of Hydraulic Systems Using Pressure Feedback for Active Damping

Acoustics-based Active Control of Unsteady Flow Dynamics using Reinforcement Learning Driven Synthetic Jets

A Two-stage Optimal Controller for Hydraulic Loading System with Mechanical Compensation

Adaptive Online Neural Predictive Control of Hydraulic Actuator Using FPGA Acceleration

Active flow control with rotating cylinders by an artificial neural network trained by deep reinforcement learning

Active control of fluid-bome noise in hydraulic systems using in-series and by-pass structures

Model-Based Reinforcement Learning Control of Electrohydraulic Position Servo Systems

Active Control Of Pressure Pulsation In A Switched Inertance Hydraulic System

Active Disturbance Rejection Control for Hydraulic Width Control System for Rough Mill

Novel Integrated Active and Passive Control of Fluid-Borne Noise in Hydraulic Systems

Active Pressure Ripple Reduction of a Self-Supplied Variable Displacement Pump with Notch Least Mean Square Filter

Novel Integrated Control of Fluid Borne Noise in Hydraulic Systems

Deep reinforcement learning based active surge control for aeroengine compressors

Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning

Deep Reinforcement Learning for Active Control of Flow over a Circular Cylinder with Rotational Oscillations

From Active Learning to Deep Reinforcement Learning: Intelligent Active Flow Control in Suppressing Vortex-Induced Vibration

Deep Reinforcement Learning for Multi-Objective Optimization: Enhancing Wind Turbine Energy Generation while Mitigating Noise Emissions

Active Control Of Pressure Pulsation In A Piping System Using Measured Dynamic Flow Rate

Hybrid Fluid-borne Noise Control in Fluid-filled Pipelines