Abstract:This study leverages deep reinforcement learning (DRL) to train synthetic jet-based flow control strategies for circular and square cylinders. The central aim is to ascertain the optimal jet placements that strike an ideal balance between energy efficiency and control effectiveness, by formulating a cohesive strategy based on a comprehensive analysis of flow control performance and energy consumption across a range of configurations. First, the results from single-action training indicate that for circle cylinder, positioning the synthetic jet approximately 105° from the stagnation point achieves the most energy-efficient and effective control strategy. For square cylinder, placing the jet near the rear corner addresses the dual objectives of minimizing energy consumption and maximizing control performance. Second, compared to single-action control, multi-action control exhibits reduced convergence speed and stability. However, simultaneously activating synthetic jets at multiple locations significantly decreases initial energy consumption and enhances energy efficiency. The findings underscore the critical importance of accurately positioning the synthetic jet at the primary flow separation point, as this alignment not only enhances flow control performance but also establishes an optimal balance between energy efficiency and control effectiveness within the flow system. Furthermore, the interaction between synthetic jets and the flow system alters surface streamline patterns and local flow structures, resulting in effects that are considerably larger in scale than the jets themselves. This study crystallizes the potential of DRL algorithms to intelligently optimize intricate flow control strategies, effectively balancing energy efficiency with enhanced flow control performance through strategically optimized jet placement.

Reinforcement-learning-based Parameter Optimization of a Splitter Plate Downstream in Cylinder Wake with Stability Analyses

Mitigating the lift of a circular cylinder in wake flow using deep reinforcement learning guided self-rotation

Efficient Active Flow Control Strategy for Confined Square Cylinder Wake Using Deep Learning-Based Surrogate Model and Reinforcement Learning

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

Surrogate model-based deep reinforcement learning for experimental study of active flow control of circular cylinder

Single-step deep reinforcement learning for open-loop control of laminar and turbulent flows

Parameter optimization of open-loop control of a circular cylinder by simplified reinforcement learning

Robust and Adaptive Deep Reinforcement Learning for Enhancing Flow Control around a Square Cylinder with Varying Reynolds Numbers

Multi-objective optimization framework for deepwater riser jetting installation parameters using deep reinforcement learning

Active flow control with rotating cylinders by an artificial neural network trained by deep reinforcement learning

Energy-efficient flow control via optimized synthetic jet placement using deep reinforcement learning

Sloshing Suppression with Active Controlled Baffles Through Deep Reinforcement Learning–expert Demonstrations–behavior Cloning Process

DRLinFluids---An open-source python platform of coupling Deep Reinforcement Learning and OpenFOAM

Optimal parallelization strategies for active flow control in deep reinforcement learning-based computational fluid dynamics

Deep reinforcement learning based synthetic jet control on disturbed flow over airfoil

Adaptive control of transonic buffet and buffeting flow with deep reinforcement learning

An Active-Controlled Heaving Plate Breakwater Trained by an Intelligent Framework Based on Deep Reinforcement Learning

Deep reinforcement learning-based active flow control of an elliptical cylinder: transitioning from an elliptical cylinder to a circular cylinder and a flat plate

Acoustics-based Active Control of Unsteady Flow Dynamics using Reinforcement Learning Driven Synthetic Jets

Deep reinforcement transfer learning for active flow control of a 3D square cylinder under state dimension mismatch