Abstract:Designing controllers to generate various trajectories has been studied for years, while recently, recovering an optimal controller from trajectories receives increasing attention. In this paper, we reveal that the inherent linear quadratic regulator (LQR) problem of a moving agent can be reconstructed based on its trajectory observations only, which enables one to learn the optimal control law of the agent autonomously. Specifically, the reconstruction of the optimization problem requires estimation of three unknown parameters including the target state, weighting matrices in the objective function and the control horizon. Our algorithm considers two types of objective function settings and identifies the weighting matrices with proposed novel inverse optimal control methods, providing the well-posedness and identifiability proof. We obtain the optimal estimate of the control horizon using binary search and finally reconstruct the LQR problem with above estimates. The strength of learning control law with optimization problem recovery lies in less computation consumption and strong generalization ability. We apply our algorithm to the future control input prediction and the discrepancy loss is further derived. Numerical simulations and hardware experiments on a self-designed robot platform illustrate the effectiveness of our work.

A didactic platform for the study of Linear Quadratic Regulator (LQR) control for Trajectory Tracking of dc motor

Robust Servo Linear Quadratic Regulator Controller Based on State Compensation and Velocity Feedforward of the Spherical Robot: Theory and Experimental Verification

A lateral and longitudinal control method based on linear quadratic regulator for intelligent vehicles considering future path changes

Research and application of trajectory tracking control algorithm based on LQR and PID

A Linear Quadratic Regulation Controller Based on Radial Basis Function Network Approximation

Sliding Mode Control Based on Linear Quadratic Regulator for an Active Magnetic Bearing Flexible Rotor Virtual Collocated System

Application of Iterative LQR on a Mobile Robot With Simple Dynamics

Model-free LQR based PID controller for trajectory tracking of 2-DoF helicopter: comparison and experimental results

Improved Linear Quadratic Regulator Lateral Path Tracking Approach Based on a Real-Time Updated Algorithm with Fuzzy Control and Cosine Similarity for Autonomous Vehicles

A Discrete-Time Direct Learning Control Scheme for Magnitude-Varying Trajectories Tracking

Trajectory Tracking Control of UAV Bicopter using Linear Quadratic Gaussian

FRIDAY: Real-time Learning DNN-based Stable LQR controller for Nonlinear Systems under Uncertain Disturbances

On the Certainty-Equivalence Approach to Direct Data-Driven LQR Design

Observation-based Optimal Control Law Learning with LQR Reconstruction

Position and heading angle control of an unmanned quadrotor helicopter using LQR method

Research on automatic parking system based on linear quadratic regulator

Tracking control for 3-DOF helicopter model based on 2-step feedback linearization

The Quadratic-Quadratic Regulator Problem: Approximating feedback controls for quadratic-in-state nonlinear systems

Automatic parking trajectory tracking control strategy on LQR and PID

Latent Linear Quadratic Regulator for Robotic Control Tasks

LQR with Tracking: A Zeroth-order Approach and Its Global Convergence