Abstract:We present a novel approach to control design for nonlinear systems which leverages model-free policy optimization techniques to learn a linearizing controller for a physical plant with unknown dynamics. Feedback linearization is a technique from nonlinear control which renders the input-output dynamics of a nonlinear plant \emph{linear} under application of an appropriate feedback controller. Once a linearizing controller has been constructed, desired output trajectories for the nonlinear plant can be tracked using a variety of linear control techniques. However, the calculation of a linearizing controller requires a precise dynamics model for the system. As a result, model-based approaches for learning exact linearizing controllers generally require a simple, highly structured model of the system with easily identifiable parameters. In contrast, the model-free approach presented in this paper is able to approximate the linearizing controller for the plant using general function approximation architectures. Specifically, we formulate a continuous-time optimization problem over the parameters of a learned linearizing controller whose optima are the set of parameters which best linearize the plant. We derive conditions under which the learning problem is (strongly) convex and provide guarantees which ensure the true linearizing controller for the plant is recovered. We then discuss how model-free policy optimization algorithms can be used to solve a discrete-time approximation to the problem using data collected from the real-world plant. The utility of the framework is demonstrated in simulation and on a real-world robotic platform.

Data-driven feedforward control design for nonlinear systems: A control-oriented system identification approach

Neural network based iterative learning predictive control design for mechatronic systems with isolated nonlinearity

Nonlinear Feedforward Control for Spacecraft Relative Attitude Tracking

Data-Driven Deep Learning Based Feedback Linearization of Systems with Unknown Dynamics

Adaptive neural identification and non-singular control of pure-feedback nonlinear systems

On Designing Event-Triggered Output Feedback Tracking Controller for Feedforward Nonlinear Systems.

Forwarding-based Trajectory Tracking Control for Nonlinear Systems with Bounded Unknown Disturbances

Design and Analysis of Data-Driven Learning Control: an Optimization-Based Approach.

Data-Based Control for Learning Systems with Nonlinear Dynamics: A Case Study

A Kernel-Based Identification Approach to LPV Feedforward: With Application to Motion Systems

Optimization-Based Design for Data-Driven Control of SISO Nonaffine Nonlinear Systems

Feedback linearization through the lens of data

An Indirect Data-Driven Method for Trajectory Tracking Control of a Class of Nonlinear Discrete-Time Systems

Optimal feedforward control with a parametric structure applied to a wafer stage.

Tracking control problem of nonlinear strict-feedback systems with input nonlinearity: An adaptive neural network dynamic surface control method

Data-based Control Design for Learning Systems

Feedback Linearization for Unknown Systems via Reinforcement Learning

Iterative Learning Tracking Control for Nonlinear Systems Based on Data Driven Control

An Improved Feedforward Controller Design Method

Data-driven control of nonlinear systems from input-output data

Data-driven finite-horizon optimal tracking control scheme for completely unknown discrete-time nonlinear systems.