Abstract:Deep Reinforcement Learning (DRL) techniques have received significant attention in control and decision-making algorithms. Most applications involve complex decision-making systems, justified by the algorithms' computational power and cost. While model-based versions are emerging, model-free DRL approaches are intriguing for their independence from models, yet they remain relatively less explored in terms of performance, particularly in applied control. This study conducts a thorough performance analysis comparing the data-driven DRL paradigm with a classical state feedback controller, both designed based on the same cost (reward) function of the linear quadratic regulator (LQR) problem. Twelve additional performance criteria are introduced to assess the controllers' performance, independent of the LQR problem for which they are designed. Two Deep Deterministic Policy Gradient (DDPG)-based controllers are developed, leveraging DDPG's widespread reputation. These controllers are aimed at addressing a challenging setpoint tracking problem in a Non-Minimum Phase (NMP) system. The performance and robustness of the controllers are assessed in the presence of operational challenges, including disturbance, noise, initial conditions, and model uncertainties. The findings suggest that the DDPG controller demonstrates promising behavior under rigorous test conditions. Nevertheless, further improvements are necessary for the DDPG controller to outperform classical methods in all criteria. While DRL algorithms may excel in complex environments owing to the flexibility in the reward function definition, this paper offers practical insights and a comparison framework specifically designed to evaluate these algorithms within the context of control engineering.

Setpoint Tracking For The Suspension System Of Medium-Speed Maglev Trains Via Reinforcement Learning

Suspension Regulation of Medium-low-speed Maglev Trains via Deep Reinforcement Learning

Reinforcement Learning-Based $\mathcal{h}_{\infty }$ Control of 2-D Markov Jump Roesser Systems with Optimal Disturbance Attenuation

Iterative Learning Tracking Control of High-Speed Trains with Nonlinearly Parameterized Uncertainties and Multiple Time-Varying Delays

State Observers for Suspension Systems with Interacting Multiple Model Unscented Kalman Filter Subject to Markovian Switching

Real-Time Adaptive Control of a Magnetic Levitation System with a Large Range of Load Disturbance

Model identification and nonlinear adaptive control of suspension system of high-speed maglev train

An Active Repetitive Learning Control Method for Lateral Suspension Systems of High-Speed Trains

A modeling and control approach to magnetic levitation system based on state-dependent ARX model

A Discrete-Time Direct Learning Control Scheme for Magnitude-Varying Trajectories Tracking

Data-Driven Control Method Based on Koopman Operator for Suspension System of Maglev Train

Reinforcement learning control method for real‐time hybrid simulation based on deep deterministic policy gradient algorithm

A Modified ADRC Scheme Based on Model Information for Maglev Train

Velocity Regulation for Automatic Train Operation Via Meta-Reinforcement Learning

Adaptive output feedback reinforcement learning control for continuous time switched stochastic nonlinear systems with unknown control coefficients and full-state constraints

A Deep Reinforcement Learning-Based Controller for Magnetorheological-Damped Vehicle Suspension

Reinforcement Learning for Input Constrained Sub-optimal Tracking Control in Discrete-time Two-time-scale Systems

Model Free Deep Deterministic Policy Gradient Controller for Setpoint Tracking of Non-minimum Phase Systems

Model-free tracking control of complex dynamical trajectories with machine learning

Deep learning based model predictive controller on a magnetic levitation ball system