Abstract:Summary The tracking performance of an actuation transfer system in a real‐time hybrid simulation (RTHS) frequently faces accuracy and robustness challenges under constraints and complicated environments with uncertainties. This study proposes a novel control approach based on the deep deterministic policy gradient algorithm in reinforcement learning (RL) combined with feedforward (FF) compensation, which emphasizes the implementation of shaking table control and substructure RTHS. The proposed method first describes the control plant within the RL environment. Then, the agent is trained offline to develop optimized control policies for interaction with the environment. A series of validation tests were conducted to assess the performance of the proposed method, starting with the dynamic testing of underwater shaking table control and then a virtual RTHS benchmark problem. For complex systems, such as controlling the underwater shaking table, the proposed algorithm, FF, and adaptive time series (ATS) compensation methods are compared under various water depths and motions. The results show better performance and wider broadband frequency applicability under different shaking table dynamic‐coupling effects. Next, a controller based on the proposed method was designed by extending the virtual RTHS via the configuration of the control plant and substructure division, as provided in the RTHS benchmark problem. The proposed RL controller also improved the tracking accuracy and robustness of conventional FF compensators against unmodeled dynamics and perturbation uncertainties. This controller can be extended to further advanced control strategies as a component of model‐based control methods.

Application of Deep Reinforcement Learning Control of an Inverted Hydraulic Pendulum

Technical Report on Reinforcement Learning Control on the Lucas-Nülle Inverted Pendulum

Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning

Adaptive Control of an Inverted Pendulum by a Reinforcement Learning-based LQR Method

Reinforcement Learning Control for Autonomous Hydraulic Material Handling Machines with Underactuated Tools

Deep Reinforcement Learning Based Controller for Active Heave Compensation

Model-Based Reinforcement Learning Control of Electrohydraulic Position Servo Systems

How to Control Hydrodynamic Force on Fluidic Pinball via Deep Reinforcement Learning

Reinforcement learning control method for real‐time hybrid simulation based on deep deterministic policy gradient algorithm

Control of a Wave Energy Converter Using Model-Free Deep Reinforcement Learning

Real-World Fluid Directed Rigid Body Control via Deep Reinforcement Learning

A Deep Reinforcement Learning Approach towards Pendulum Swing-up Problem based on TF-Agents

Model-Based Reinforcement Learning for Control of Strongly-Disturbed Unsteady Aerodynamic Flows

Deep reinforcement learning with reward shaping for tracking control and vibration suppression of flexible link manipulator

Increasing the Flexibility of Hydropower with Reinforcement Learning on a Digital Twin Platform

Single-step deep reinforcement learning for open-loop control of laminar and turbulent flows

Balance Controller Design for Inverted Pendulum Considering Detail Reward Function and Two-Phase Learning Protocol

An Active-Controlled Heaving Plate Breakwater Trained by an Intelligent Framework Based on Deep Reinforcement Learning

Deep reinforcement learning in dynamic positioning control: by rewarding small response of riser angles

Recent advances in applying deep reinforcement learning for flow control: perspectives and future directions

Safe reward‐based deep reinforcement learning control for an electro‐hydraulic servo system