Abstract:In this paper, a novel online, output-feedback, critic-only, model-based reinforcement learning framework is developed for safety-critical control systems operating in complex environments. The developed framework ensures system stability and safety, regardless of the lack of full-state measurement, while learning and implementing an optimal controller. The approach leverages linear matrix inequality-based observer design method to efficiently search for observer gains for effective state estimation. Then, approximate dynamic programming is used to develop an approximate controller that uses simulated experiences to guarantee the safety and stability of the closed-loop system. Safety is enforced by adding a recentered robust Lyapunov-like barrier function to the cost function that effectively enforces safety constraints, even in the presence of uncertainty in the state. Lyapunov-based stability analysis is used to guarantee uniform ultimate boundedness of the trajectories of the closed-loop system and ensure safety. Simulation studies are performed to demonstrate the effectiveness of the developed method through two real-world safety-critical scenarios, ensuring that the state trajectories of a given system remain in a given set and obstacle avoidance.

Online Output-Feedback Optimal Control of Linear Systems Based on Data-Driven Adaptive Learning

Adaptive Output-Feedback Control of Nonlinear Systems with Unknown Nonlinearities.

Output-Feedback Robust Control of Uncertain Systems Via Online Data-Driven Learning

Data-Driven Online Adaptive Optimal Control for Linear Systems with Completely Unknown Dynamics

Data-Driven Based Optimal Output-Feedback Control of Continuous-Time Systems

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Online Policy Learning-Based Output-Feedback Optimal Control of Continuous-Time Systems

Output-feedback Robust Tracking Control of Uncertain Systems via Adaptive Learning

Output Feedback Adaptive Optimal Control of Affine Nonlinear systems with a Linear Measurement Model

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

State and Input Constrained Output-Feedback Adaptive Optimal Control of Affine Nonlinear Systems

Output‐feedback Robust Control of Systems with Uncertain Dynamics Via Data‐driven Policy Learning

An Online Algorithm for Solving Feedback Optimal Control Problems with Partial Observations

Online Data-Driven Adaptive Control for Unknown Linear Time-Varying Systems

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Data-driven Adaptive Optimal Control for Discrete-Time Linear Time-Invariant Systems

Adaptive Robust Control for Uncertain Systems Via Data-Driven Learning.

An Information-state based Approach to the Optimal Output Feedback Control of Nonlinear Systems

Optimal dynamic output feedback control of unknown linear continuous-time systems by adaptive dynamic programming

Data-Driven Deep Learning Based Feedback Linearization of Systems with Unknown Dynamics

Adaptive Output-Feedback Optimal Control for Continuous-Time Linear Systems Based on Adaptive Dynamic Programming Approach