Abstract:This study leverages deep reinforcement learning (DRL) to train synthetic jet-based flow control strategies for circular and square cylinders. The central aim is to ascertain the optimal jet placements that strike an ideal balance between energy efficiency and control effectiveness, by formulating a cohesive strategy based on a comprehensive analysis of flow control performance and energy consumption across a range of configurations. First, the results from single-action training indicate that for circle cylinder, positioning the synthetic jet approximately 105° from the stagnation point achieves the most energy-efficient and effective control strategy. For square cylinder, placing the jet near the rear corner addresses the dual objectives of minimizing energy consumption and maximizing control performance. Second, compared to single-action control, multi-action control exhibits reduced convergence speed and stability. However, simultaneously activating synthetic jets at multiple locations significantly decreases initial energy consumption and enhances energy efficiency. The findings underscore the critical importance of accurately positioning the synthetic jet at the primary flow separation point, as this alignment not only enhances flow control performance but also establishes an optimal balance between energy efficiency and control effectiveness within the flow system. Furthermore, the interaction between synthetic jets and the flow system alters surface streamline patterns and local flow structures, resulting in effects that are considerably larger in scale than the jets themselves. This study crystallizes the potential of DRL algorithms to intelligently optimize intricate flow control strategies, effectively balancing energy efficiency with enhanced flow control performance through strategically optimized jet placement.

An application of data driven reward of deep reinforcement learning by dynamic mode decomposition in active flow control

Robust and Adaptive Deep Reinforcement Learning for Enhancing Flow Control around a Square Cylinder with Varying Reynolds Numbers

Deep reinforcement learning based synthetic jet control on disturbed flow over airfoil

Towards Active Flow Control Strategies Through Deep Reinforcement Learning

Deep Reinforcement Learning for Active Flow Control around a Circular Cylinder Using Unsteady-mode Plasma Actuators

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

Surrogate model-based deep reinforcement learning for experimental study of active flow control of circular cylinder

Deep reinforcement transfer learning for active flow control of a 3D square cylinder under state dimension mismatch

Effect of Synthetic Jets Actuator Parameters on Deep Reinforcement Learning-Based Flow Control Performance in a Square Cylinder

Active flow control with rotating cylinders by an artificial neural network trained by deep reinforcement learning

Accelerating Deep Reinforcement Learning strategies of Flow Control through a multi-environment approach

Energy-efficient flow control via optimized synthetic jet placement using deep reinforcement learning

Deep reinforcement learning-based active flow control of vortex-induced vibration of a square cylinder

Deep reinforcement learning-based active flow control of an elliptical cylinder: transitioning from an elliptical cylinder to a circular cylinder and a flat plate

Accelerating and improving deep reinforcement learning-based active flow control: Transfer training of policy network

Active Control of Flow over Rotating Cylinder by Multiple Jets using Deep Reinforcement Learning

Optimal parallelization strategies for active flow control in deep reinforcement learning-based computational fluid dynamics

Optimizing Flow Control with Deep Reinforcement Learning: Plasma Actuator Placement around a Square Cylinder

Deep Reinforcement Learning for Active Control of Flow over a Circular Cylinder with Rotational Oscillations

Recent advances in applying deep reinforcement learning for flow control: perspectives and future directions