Abstract:Reinforcement learning is showing great potentials in robotics applications,including autonomous driving, robot manipulation and locomotion. However, withcomplex uncertainties in the real-world environment, it is difficult toguarantee the successful generalization and sim-to-real transfer of learnedpolicies theoretically. In this paper, we introduce and extend the idea ofrobust stability and H_∞ control to design policies with both stabilityand robustness guarantee. Specifically, a sample-based approach for analyzingthe Lyapunov stability and performance robustness of a learning-based controlsystem is proposed. Based on the theoretical results, a maximum entropyalgorithm is developed for searching Lyapunov function and designing a policywith provable robust stability guarantee. Without any specific domainknowledge, our method can find a policy that is robust to various uncertaintiesand generalizes well to different test environments. In our experiments, weshow that our method achieves better robustness to both large impulsivedisturbances and parametric variations in the environment than the state-of-artresults in both robust and generic RL, as well as classic control. Anonymouscode is available to reproduce the experimental results athttps://github.com/RobustStabilityGuaranteeRL/RobustStabilityGuaranteeRL.

Robust H∞ Control of Unknown Discrete-Time Linear Systems with Time-Varying Uncertainties

Robust H∞ control for time-delay systems with additive controller uncertainty

Robust Hinfinity Controller Design for Time-Varying Uncertain Linear Systems with Time-Varying State and Control Delays

Reliable H∞ Control for Uncertain Time-Delay Systems Using LMI

Robust H∞ control for linear time-delay systems subject to norm-bounded nonlinear uncertainty

DELAY-DEPENDENT ROBUST H∞ CONTROL FOR UNCERTAIN STATE DELAYED SYSTEMS

Data-Driven Robust Control of Discrete-Time Uncertain Linear Systems Via Off-Policy Reinforcement Learning.

Robust H∞ Control of Time-Varying Systems with Stochastic Non-Linearities: the Finite-Horizon Case

The Robust H ∞ Performance Problem for Systems with General Nonlinear Uncertainties

Robust H ∞ Control for a Class of Uncertain Mechanical Systems

H∞ Control of Linear Discrete‐Time Systems with Norm‐Bounded Nonlinear Uncertainties

Robust H~∞ Controller Design for a Class of Uncertain Systems

Robust H_∞ Control of Discrete-time Systems with Uncertainty

Robust reliable H_∞ control for a class of uncertain time-delay systems

Robust H∞ control for discrete singular systems with time-varying delays and uncertainties

Robust Control of Uncertain Linear Systems Based on Reinforcement Learning Principles.

H_∞ Model-free Reinforcement Learning with Robust Stability Guarantee

Game Theoretical Reinforcement Learning for Robust H∞ Tracking Control of Discrete-Time Linear Systems with Unknown Dynamics

Robust H Infinity Control for Discrete-Time Switched Linear Systems Subject to Exponential Uncertainty

Robust Reliable H∞ Control for a Class of Uncertain Time-Delay Systems

Robust H ∞ Control for Uncertain Systems with Heterogeneous Time-Varying Delays Via Static Output Feedback