Abstract:Summary The tracking performance of an actuation transfer system in a real‐time hybrid simulation (RTHS) frequently faces accuracy and robustness challenges under constraints and complicated environments with uncertainties. This study proposes a novel control approach based on the deep deterministic policy gradient algorithm in reinforcement learning (RL) combined with feedforward (FF) compensation, which emphasizes the implementation of shaking table control and substructure RTHS. The proposed method first describes the control plant within the RL environment. Then, the agent is trained offline to develop optimized control policies for interaction with the environment. A series of validation tests were conducted to assess the performance of the proposed method, starting with the dynamic testing of underwater shaking table control and then a virtual RTHS benchmark problem. For complex systems, such as controlling the underwater shaking table, the proposed algorithm, FF, and adaptive time series (ATS) compensation methods are compared under various water depths and motions. The results show better performance and wider broadband frequency applicability under different shaking table dynamic‐coupling effects. Next, a controller based on the proposed method was designed by extending the virtual RTHS via the configuration of the control plant and substructure division, as provided in the RTHS benchmark problem. The proposed RL controller also improved the tracking accuracy and robustness of conventional FF compensators against unmodeled dynamics and perturbation uncertainties. This controller can be extended to further advanced control strategies as a component of model‐based control methods.

Validation of model-based adaptive control method for real-time hybrid simulation

A model-based adaptive control method for real-time hybrid simulation

A Novel Model-Based Adaptive Feedforward-Feedback Control Method for Real-Time Hybrid Simulation Considering Additive Error Model

Decoupled Adaptive Terminal Sliding Mode Control Strategy for a 6-DOF Electro-Hydraulic Suspension Test Rig with RBF Coupling Force Compensator

Kalman Filter-Based Adaptive Delay Compensation for Benchmark Problem in Real-Time Hybrid Simulation

An Adaptive and Robust Control Strategy for Real-Time Hybrid Simulation

Using real-time hybrid simulation for active mass damper experimentation and validation

Real-time hybrid simulation based on inner-loop H∞ control

Robust Actuator Dynamics Compensation Method for Real-Time Hybrid Simulation

Adaptive compensation using long short‐term memory networks for improved control performance in real‐time hybrid simulation

An Adaptive Sliding Mode Control System and Its Application to Real‐time Hybrid Simulation

High Performance Compensation Using an Adaptive Strategy for Real-Time Hybrid Simulation

Adaptive Feedforward and Feedback Compensation Method for Real-time Hybrid Simulation Based on a Discrete Physical Testing System Model

Adaptive Experimental Design of Real-Time Hybrid Simulation for Parameter Calibration of Rate-Dependent Devices Toward Optimal Response Prediction

Minimizing Actuator Tracking and Energy Errors for Real-Time Hybrid Simulation Through a New Adaptive Compensation Scheme

Reinforcement learning control method for real‐time hybrid simulation based on deep deterministic policy gradient algorithm

Large-Scale Real-Time Hybrid Simulation for Evaluation of Advanced Damping System Performance

Combined Control Strategy Using Internal Model Control and Adaptive Inverse Control for Electro-Hydraulic Shaking Table

Evaluation of Control Accuracy for a Boundary-Coordinating Device in a Real-Time Hybrid Test

Stability and Accuracy Analysis of Real-Time Hybrid Simulation (RTHS) with Incomplete Boundary Conditions and Actuator Delay

Adaptive Compound Control for the Real‐time Hybrid Simulation of High‐speed Railway Train–bridge Coupling Vibration