Abstract:This study leverages deep reinforcement learning (DRL) to train synthetic jet-based flow control strategies for circular and square cylinders. The central aim is to ascertain the optimal jet placements that strike an ideal balance between energy efficiency and control effectiveness, by formulating a cohesive strategy based on a comprehensive analysis of flow control performance and energy consumption across a range of configurations. First, the results from single-action training indicate that for circle cylinder, positioning the synthetic jet approximately 105° from the stagnation point achieves the most energy-efficient and effective control strategy. For square cylinder, placing the jet near the rear corner addresses the dual objectives of minimizing energy consumption and maximizing control performance. Second, compared to single-action control, multi-action control exhibits reduced convergence speed and stability. However, simultaneously activating synthetic jets at multiple locations significantly decreases initial energy consumption and enhances energy efficiency. The findings underscore the critical importance of accurately positioning the synthetic jet at the primary flow separation point, as this alignment not only enhances flow control performance but also establishes an optimal balance between energy efficiency and control effectiveness within the flow system. Furthermore, the interaction between synthetic jets and the flow system alters surface streamline patterns and local flow structures, resulting in effects that are considerably larger in scale than the jets themselves. This study crystallizes the potential of DRL algorithms to intelligently optimize intricate flow control strategies, effectively balancing energy efficiency with enhanced flow control performance through strategically optimized jet placement.

Parameter optimization of open-loop control of a circular cylinder by simplified reinforcement learning

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

Accelerating Reinforcement Learning with Local Data Enhancement for Process Control

Deep Reinforcement Learning for Active Control of Flow over a Circular Cylinder with Rotational Oscillations

System Identification and Model Predictive Control of Vortex Shedding Behind a Rotating Cylinder

Surrogate model-based deep reinforcement learning for experimental study of active flow control of circular cylinder

Deep reinforcement learning-based active flow control of an elliptical cylinder: transitioning from an elliptical cylinder to a circular cylinder and a flat plate

Single-step deep reinforcement learning for open-loop control of laminar and turbulent flows

Robust and Adaptive Deep Reinforcement Learning for Enhancing Flow Control around a Square Cylinder with Varying Reynolds Numbers

Accelerating and improving deep reinforcement learning-based active flow control: Transfer training of policy network

Reinforcement-learning-based Parameter Optimization of a Splitter Plate Downstream in Cylinder Wake with Stability Analyses

Active flow control with rotating cylinders by an artificial neural network trained by deep reinforcement learning

Machine-learning flow control with few sensor feedback and measurement noise

Performance analysis of reinforcement learning algorithms on intelligent closed-loop control on fluid flow and convective heat transfer

Deep Reinforcement Learning for Active Flow Control around a Circular Cylinder Using Unsteady-mode Plasma Actuators

Optimizing Flow Control with Deep Reinforcement Learning: Plasma Actuator Placement around a Square Cylinder

Energy-efficient flow control via optimized synthetic jet placement using deep reinforcement learning

Mitigating the lift of a circular cylinder in wake flow using deep reinforcement learning guided self-rotation

Deep reinforcement learning based synthetic jet control on disturbed flow over airfoil

From Active Learning to Deep Reinforcement Learning: Intelligent Active Flow Control in Suppressing Vortex-Induced Vibration

Model-Based Reinforcement Learning for Control of Strongly-Disturbed Unsteady Aerodynamic Flows