Abstract:We present a novel approach to control design for nonlinear systems which leverages model-free policy optimization techniques to learn a linearizing controller for a physical plant with unknown dynamics. Feedback linearization is a technique from nonlinear control which renders the input-output dynamics of a nonlinear plant \emph{linear} under application of an appropriate feedback controller. Once a linearizing controller has been constructed, desired output trajectories for the nonlinear plant can be tracked using a variety of linear control techniques. However, the calculation of a linearizing controller requires a precise dynamics model for the system. As a result, model-based approaches for learning exact linearizing controllers generally require a simple, highly structured model of the system with easily identifiable parameters. In contrast, the model-free approach presented in this paper is able to approximate the linearizing controller for the plant using general function approximation architectures. Specifically, we formulate a continuous-time optimization problem over the parameters of a learned linearizing controller whose optima are the set of parameters which best linearize the plant. We derive conditions under which the learning problem is (strongly) convex and provide guarantees which ensure the true linearizing controller for the plant is recovered. We then discuss how model-free policy optimization algorithms can be used to solve a discrete-time approximation to the problem using data collected from the real-world plant. The utility of the framework is demonstrated in simulation and on a real-world robotic platform.

Direct Learning for Parameter-Varying Feedforward Control: A Neural-Network Approach

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

A Kernel-Based Identification Approach to LPV Feedforward: With Application to Motion Systems

Data-Driven Feedforward Tuning Approach for LPV Motion Systems

APPLICATION OF ITERATIVE LEARNING CONTROL BASED ON NEURAL NETWORK

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

A Linear Parameter-Varying Approach to Data Predictive Control

Deterministic Learning-Based Adaptive Neural Control for Nonlinear Full-State Constrained Systems.

Direct Data-Driven State-Feedback Control of Linear Parameter-Varying Systems

Data-Driven Deep Learning Based Feedback Linearization of Systems with Unknown Dynamics

Neural Network Control-Based Adaptive Learning Design for Nonlinear Systems with Full-State Constraints.

Direct Adaptive Neural Control for Stabilization of Nonlinear Time-Delay Systems

A Parameter Dependent Controller Design Approach for Delayed LPV System

Dynamic Learning from Neural Network‐based Control for Sampled‐data Strict‐feedback Nonlinear Systems

Physics-Guided Neural Networks for Feedforward Control: An Orthogonal Projection-Based Approach

Data enabled Predictive Control of LPV systems

Finite-Time Convergence Adaptive Neural Network Control for Nonlinear Servo Systems

Application of feedforward and recurrent neural networks for model-based control systems

Data-driven feedforward control design for nonlinear systems: A control-oriented system identification approach

Learning Feedforward and Recurrent Deterministic Spiking Neuron Network Feedback Controllers

Feedback Linearization for Unknown Systems via Reinforcement Learning