Identification of nonlinear controllers from data: theory and computation

Lorenzo Fagiano,Carlo Novara

DOI: https://doi.org/10.1109/TAC.2015.2479520

2013-09-06

Abstract:This manuscript contains technical details and proofs of recent results developed by the authors, pertaining to the design of nonlinear controllers from the experimental data measured on an existing feedback control system.

Systems and Control,Dynamical Systems,Optimization and Control

What problem does this paper attempt to address?

A Controller-Design Method For Nonlinear-Systems Via A Staged-Transformation Technique

J Chu,Hy Su

DOI: https://doi.org/10.1080/00207729508929162

IF: 2.648

1995-01-01

International Journal of Systems Science

Abstract:The paper addresses a controller design approach for nonlinear systems based on a staged-transformation technique. A new nonlinear state transformation is proposed to transform a complex single-input nonlinear system into a simple intermediate nonlinear model, a nonlinear state feedback is then introduced to transform the intermediate nonlinear model into a linear controllable canonical form. The optimal nonlinear controller to the primitive nonlinear system is derived via a staged-design method. Furthermore, an optimal tracking control law for nonlinear systems is developed. The simulation result of an inverted pendulum example shows that this approach is quite effective, and the nonlinear controller is robust to parameter perturbations.
On adaptive control of nonlinearly parameterized nonlinear systems: Towards a constructive procedure

Xiangbin Liu,Romeo Ortega,Hongye Su,Jian Chu

DOI: https://doi.org/10.1016/j.sysconle.2010.10.004

IF: 2.742

2011-01-01

Systems & Control Letters

Abstract:A new framework to design immersion and invariance adaptive controllers for nonlinearly parameterized, nonlinear systems was recently proposed by the authors. The key step is the construction of a monotone mapping, via a suitable selection of a controller tuning function, which has to satisfy some integrability conditions—this translates into the need to solve a partial differential equation (PDE). In this paper this result is extended providing some answers to the questions of characterization of “monotonizable” systems and solvability of the PDE. First, adding to the design a nonlinear dynamic scaling, we obviate the need to solve the PDE. Second, for the case of factorizable nonlinearities, the following results are established. (i) It is shown that the monotonicity condition is satisfied if a linear matrix inequality is feasible. (ii) Directly verifiable involutivity conditions that ensure the solution of the PDE are presented. (iii) An explicit formula for the required tuning function is given, provided the regressor matrix satisfies some rank conditions. Hence, adding a dynamic scaling, this yields a constructive solution to the problem.
Immersion and Invariance Adaptive Control of Nonlinearly Parameterized Nonlinear Systems

Xiangbin Liu,Romeo Ortega,Hongye Su,Jian Chu

DOI: https://doi.org/10.1109/tac.2010.2052389

2010-01-01

IFAC Proceedings Volumes

Abstract:A new framework to design adaptive controllers for nonlinearly parameterized systems is proposed in this paper. The key step is the construction of a monotone function, which explicitly depends on some of the estimator tuning parameters. Monotonicity—or the related property of convexity—have already been explored by several authors with convexity being an a priori assumption that is valid only on some region of state space. In our approach monotonicity is enforced by the designer, effectively becoming a synthesis tool. One consequence of this fact is that the controller does not rely on state—dependent switching. In order to dispose of degrees of freedom to render the function monotone we depart from standard adaptive control and adopt instead the recently introduced Immersion and Invariance approach.
Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

Yanping Tian,Xiaoling Jin,Lingling Wu,Ying Yang,Yong Wang,Zhilong Huang

DOI: https://doi.org/10.1115/1.4049632

2021-01-01

Journal of Applied Mechanics

Abstract:The response control of nonlinear random dynamical systems is an important but also difficult subject in scientific and industrial fields. This work merges the decomposition technique of feedback control and the data-driven identification method of stationary response probability density, converts the constrained functional extreme value problem associated with optimal control to an unconstrained optimization problem of multivariable function, and determines the optimal coefficients of preselected control terms by an optimization algorithm. This data-driven method avoids the difficulty of solving the stochastic dynamic programming equation or forward–backward stochastic differential equations encountered in classical control theories, the miss of the conservative mechanism in the nonlinear stochastic optimal control strategy, and the difficulty of judging the integrability and resonance of the controlled Hamiltonian systems encountered in the direct-control method. The application and efficacy of the data-driven method are illustrated by the random response control problems of the Duffing oscillator, van der Pol system, and a two degrees-of-freedom nonlinear system.
Adaptive Controller and Observer Design for A Class of Nonlinear Systems

Yongliang Zhu,Prabhakar R. Pagilla

DOI: https://doi.org/10.1115/1.2234489

2006-01-01

Abstract:Design of a stable adaptive controller and observer for a class of nonlinear systems that contain product Of immeasurable states and unknown parameters is considered. The nonlinear system is cast into a suitable from based on which a stable adaptive controller and observer are designed using a parameter dependent Lyapunov function. The class of nonlinear systems considered is practically relevant; mechanical systems with dynamic friction fall into this category. Experimental results on a single-link mechanical system with dynamic friction are shown for the proposed design.
Data-driven control of nonlinear systems from input-output data

Xiaoyan Dai,Claudio De Persis,Nima Monshizadeh,Pietro Tesi

DOI: https://doi.org/10.1109/CDC49753.2023.10384071

2023-09-17

Abstract:The design of controllers from data for nonlinear systems is a challenging problem. In a recent paper, De Persis, Rotulo and Tesi, "Learning controllers from data via approximate nonlinearity cancellation," IEEE Transactions on Automatic Control, 2023, a method to learn controllers that make the closed-loop system stable and dominantly linear was proposed. The approach leads to a simple solution based on data-dependent semidefinite programs. The method uses input-state measurements as data, while in a realistic setup it is more likely that only input-output measurements are available. In this note we report how the design principle of the above mentioned paper can be adjusted to deal with input-output data and obtain dynamic output feedback controllers in a favourable setting.

Systems and Control,Optimization and Control
Designing Experiments for Data-Driven Control of Nonlinear Systems

Claudio De Persis,Pietro Tesi

DOI: https://doi.org/10.48550/arXiv.2103.16509

2021-03-31

Abstract:In a recent paper we have shown that data collected from linear systems excited by persistently exciting inputs during low-complexity experiments, can be used to design state- and output-feedback controllers, including optimal Linear Quadratic Regulators (LQR), by solving linear matrix inequalities (LMI) and semidefinite programs. We have also shown how to stabilize in the first approximation unknown nonlinear systems using data. In contrast to the case of linear systems, however, in the case of nonlinear systems the conditions for learning a controller directly from data may not be fulfilled even when the data are collected in experiments performed using persistently exciting inputs. In this paper we show how to design experiments that lead to the fulfilment of these conditions.

Systems and Control
Feedback linearization through the lens of data

C. De Persis,D. Gadginmath,F. Pasqualetti,P. Tesi

2024-06-25

Abstract:Controlling nonlinear systems, especially when data are being used to offset uncertainties in the model, is hard. A natural approach when dealing with the challenges of nonlinear control is to reduce the system to a linear one via change of coordinates and feedback, an approach commonly known as feedback linearization. Here we consider the feedback linearization problem of an unknown system when the solution must be found using experimental data. We propose a new method that learns the change of coordinates and the linearizing controller from a library (a dictionary) of candidate functions with a simple algebraic procedure - the computation of the null space of a data-dependent matrix. Remarkably, we show that the solution is valid over the entire state space of interest and not just on the dataset used to determine the solution.

Systems and Control,Optimization and Control
Data-driven feedforward control design for nonlinear systems: A control-oriented system identification approach

Max Bolderman,Mircea Lazar,Hans Butler

DOI: https://doi.org/10.1109/CDC49753.2023.10383648

2023-06-12

Abstract:Feedforward controllers typically rely on accurately identified inverse models of the system dynamics to achieve high reference tracking performance. However, the impact of the (inverse) model identification error on the resulting tracking error is only analyzed a posteriori in experiments. Therefore, in this work, we develop an approach to feedforward control design that aims at minimizing the tracking error a priori. To achieve this, we present a model of the system in a lifted space of trajectories, based on which we derive an upperbound on the reference tracking performance. Minimization of this bound yields a feedforward control-oriented system identification cost function, and a finite-horizon optimization to compute the feedforward control signal. The nonlinear feedforward control design method is validated using physics-guided neural networks on a nonlinear, nonminimum phase mechatronic example, where it outperforms linear ILC.

Systems and Control
ℒ1adaptive Controller for a Class of Non-Affine Multi-Input Multi-Output Nonlinear Systems

Jie Luo,Chengyu Cao,Qinmin Yang

DOI: https://doi.org/10.1080/00207179.2012.731727

IF: 2.102

2012-01-01

International Journal of Control

Abstract:In this article, an extension of the ℒ1 adaptive control design is introduced for a class of non-affine Multi-Input Multi-Output nonlinear systems with unknown dynamics and unmeasured states. The system dynamics is represented in the normal form with the bounded-input-bounded-output internal dynamics. At first, a stable virtual reference counterpart is constructed. Thereafter, a piece-wise continuous adaptive law is introduced to the actual system along with a low-pass filtered control signal that allows for achieving arbitrarily close tracking of the input and the output signals of the reference system. Rigorous mathematical proof is provided, and the theoretical results are verified with the simulation.
Identification For Control Based on Neural Networks: Approximately Linearizable Models

Maxime Thieffry,Alexandre Hache,Mohamed Yagoubi,Philippe Chevrel

2024-10-03

Abstract:This work presents a control-oriented identification scheme for efficient control design and stability analysis of nonlinear systems. Neural networks are used to identify a discrete-time nonlinear state-space model to approximate time-domain input-output behavior of a nonlinear system. The network is constructed such that the identified model is approximately linearizable by feedback, ensuring that the control law trivially follows from the learning stage. After the identification and quasi-linearization procedures, linear control theory comes at hand to design robust controllers and study stability of the closed-loop system. The effectiveness and interest of the methodology are illustrated throughout the paper on popular benchmarks for system identification.

Systems and Control,Artificial Intelligence
Direct data-driven state-feedback control of general nonlinear systems

Chris Verhoek,Patrick J. W. Koelewijn,Sofie Haesaert,Roland Tóth

DOI: https://doi.org/10.1109/CDC49753.2023.10384139

2023-09-26

Abstract:Through the use of the Fundamental Lemma for linear systems, a direct data-driven state-feedback control synthesis method is presented for a rather general class of nonlinear (NL) systems. The core idea is to develop a data-driven representation of the so-called velocity-form, i.e., the time-difference dynamics, of the NL system, which is shown to admit a direct linear parameter-varying (LPV) representation. By applying the LPV extension of the Fundamental Lemma in this velocity domain, a state-feedback controller is directly synthesized to provide asymptotic stability and dissipativity of the velocity-form. By using realization theory, the synthesized controller is realized as a NL state-feedback law for the original unknown NL system with guarantees of universal shifted stability and dissipativity, i.e., stability and dissipativity w.r.t. any (forced) equilibrium point, of the closed-loop behavior. This is achieved by the use of a single sequence of data from the system and a predefined basis function set to span the scheduling map. The applicability of the results is demonstrated on a simulation example of an unbalanced disc.

Systems and Control
Data-Driven Deep Learning Based Feedback Linearization of Systems with Unknown Dynamics

Raktim Gautam Goswami,Prashanth Krishnamurthy,Farshad Khorrami

2023-05-22

Abstract:A methodology is developed to learn a feedback linearization (i.e., nonlinear change of coordinates and input transformation) using a data-driven approach for a single input control-affine nonlinear system with unknown dynamics. We employ deep neural networks to learn the feedback law (input transformation) in conjunction with an extension of invertible neural networks to learn the nonlinear change of coordinates (state transformation). We also learn the matrices A and B of the transformed linear system and define loss terms to ensure controllability of the pair (A, B). The efficacy of our approach is demonstrated by simulations on several nonlinear systems. Furthermore, we show that state feedback controllers designed using the feedback linearized system yield expected closed-loop behavior when applied to the original nonlinear system, further demonstrating validity of the learned feedback linearization.

Systems and Control
Meta results on data-driven control of nonlinear systems

Nima Monshizadeh,Claudio De Persis,Pietro Tesi

2024-05-16

Abstract:This note aims to provide a systematic understanding of direct data-driven control, enriching the existing literature not by adding another isolated result, but rather by offering a comprehensive, versatile, and unifying framework that sets the stage for future explorations and applications in this domain. To this end, we formulate the nonlinear design problem from a high-level perspective as a set of desired controlled systems and propose systematic procedures to synthesize data-driven control algorithms that meet the design requirements specified in the desired set. Various examples are presented to demonstrate the comprehensiveness and adaptability of the proposed approach.

Systems and Control,Optimization and Control
Control of nonlinear systems: a model inversion approach

C. Novara,M. Milanese

DOI: https://doi.org/10.48550/arXiv.1407.1069

2014-07-04

Abstract:A novel control design approach for general nonlinear systems is presented in this paper. The approach is based on the identification of a polynomial model of the system to control and on the on-line inversion of this model. An efficient technique is developed to perform the inversion, which allows an effective control implementation on real-time processors.

Systems and Control
Learning Control-Oriented Dynamical Structure from Data

Spencer M. Richards,Jean-Jacques Slotine,Navid Azizan,Marco Pavone

2023-06-24

Abstract:Even for known nonlinear dynamical systems, feedback controller synthesis is a difficult problem that often requires leveraging the particular structure of the dynamics to induce a stable closed-loop system. For general nonlinear models, including those fit to data, there may not be enough known structure to reliably synthesize a stabilizing feedback controller. In this paper, we discuss a state-dependent nonlinear tracking controller formulation based on a state-dependent Riccati equation for general nonlinear control-affine systems. This formulation depends on a nonlinear factorization of the system of vector fields defining the control-affine dynamics, which always exists under mild smoothness assumptions. We propose a method for learning this factorization from a finite set of data. On a variety of simulated nonlinear dynamical systems, we empirically demonstrate the efficacy of learned versions of this controller in stable trajectory tracking. Alongside our learning method, we evaluate recent ideas in jointly learning a controller and stabilizability certificate for known dynamical systems; we show experimentally that such methods can be frail in comparison.

Systems and Control,Machine Learning,Robotics
A System Level Approach to Discrete-Time Nonlinear Systems

Dimitar Ho

DOI: https://doi.org/10.48550/arXiv.2004.08004

2020-04-17

Abstract:We will show that there is a universal connection between the achievable closed-loop dynamics and the corresponding feedback controller that produces it. This connection shows promise to lead to new methods for robust nonlinear control in discrete-time. We will show that, given a causal nonlinear discrete-time system and controller, the resulting closed-loop is a solution to a nonlinear operator equation. Conversely, any causal solution to the nonlinear operator equation is a closed-loop that can be achieved by some causal controller. Moreover, solutions can be substituted into a simple dynamic controller structure, which we will refer to as a system level controller, to obtain an implementation of the unique corresponding feedback controller. System level controllers could be an attractive approach for robust nonlinear control, as we will show that even when they are parametrized with approximate solutions to the operator equation, they can still produce robustly stable closed loops. We will provide theoretical results that state how grade of approximation and robust stability of the closed loop are related. Additionally, we will explore some first applications of our results. Using the cart-pole system as an illustrative example, we will derive how to design robust discrete-time trajectory tracking controllers for continuous-time nonlinear systems. Secondly, we will introduce a particular class of system level controller that shows to be particularly useful for linear systems with actuator saturation and state constraints. The special structure of the controller allows for simple stability and performance analysis of the closed-loop in presence of disturbances. A particular application to large-scale systems with actuator saturation and safety constraints is presented in our companion paper.

Systems and Control,Optimization and Control
Data-Driven Optimal Control Using Transfer Operators

Apurba Kumar Das,Bowen Huang,Umesh Vaidya

DOI: https://doi.org/10.1109/cdc.2018.8619057

2018-12-01

Abstract:In this paper, we propose a data-driven approach for control of nonlinear dynamical systems. The proposed data-driven approach relies on transfer Koopman and Perron-Frobenius (P-F) operators for linear representation and control of such systems. Systematic model-based frameworks involving linear transfer P-F operator were proposed for almost everywhere stability analysis and control design of a nonlinear dynamical system in previous works [1]–[3]. Lyapunov measure can be used as a tool to provide linear programming-based computational framework for stability analysis and optimal control design of a nonlinear system. In this paper, we show that the Lyapunov measure-based framework can extended to a data-driven setting, where the finite dimensional approximation of linear transfer P-F operator and optimal control can be obtained from time-series data. We exploit the positivity and Markov property of P-F operator to provide linear programming based approach for designing an optimally stabilizing feedback controller.
Nonlinear system identification in coherence with nonlinearity measure for dynamic physical systems—case studies

Joanofarc Xavier,S. K. Patnaik,Rames C. Panda

DOI: https://doi.org/10.1007/s11071-023-09258-0

IF: 5.741

2024-02-06

Nonlinear Dynamics

Abstract:With the recent success in using time series data, many nonlinear identification tools have emerged to learn the nonlinear dynamics of unknown physical systems. However, if the nonlinearity level is very high or too small, in many cases, the identified model fails to precisely learn the actual dynamics of the system, which in turn makes the closed-loop control more challenging. Finding out a suitable system identification routine for identifying a given nonlinear system based on the nonlinearity level is still cryptic. In this article, we propose an integrated framework 'System identification in coherence with nonlinearity measure' that involves three reliable nonlinear system identification methods and a 'Convergence area-based Nonlinear Metric' (CANM). The nonlinear identification methods in order are (a) An enhanced key term-based Sparse Identification of Nonlinear Dynamics with control (kSINDYc) (b) Standard Nonlinear Least Square method (NL2SQ) and (c) Neural Network-based Nonlinear Auto Regressive Exogenous input (N3ARX) schemes. This article revolves around the central idea of developing kSINDYc to capture the nonlinear dynamics of high nonlinear systems. Furthermore, the nonlinear metric CANM computes the process nonlinearity in the dynamic physical systems that classify the unknown process under mild, medium or highly nonlinear categories. Simulation studies are carried out on five industrial systems with divergent nonlinear dynamics. The user can make a flawless choice of a specific identification method suitable for a given process from CANM.

engineering, mechanical,mechanics
[Surgery of superficial femoral artery and popliteal artery].

G. Stalpaert

Angeiologie

Abstract:

Identification of nonlinear controllers from data: theory and computation

A Controller-Design Method For Nonlinear-Systems Via A Staged-Transformation Technique

On adaptive control of nonlinearly parameterized nonlinear systems: Towards a constructive procedure

Immersion and Invariance Adaptive Control of Nonlinearly Parameterized Nonlinear Systems

Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

Adaptive Controller and Observer Design for A Class of Nonlinear Systems

Data-driven control of nonlinear systems from input-output data

Designing Experiments for Data-Driven Control of Nonlinear Systems

Feedback linearization through the lens of data

Data-driven feedforward control design for nonlinear systems: A control-oriented system identification approach

ℒ1adaptive Controller for a Class of Non-Affine Multi-Input Multi-Output Nonlinear Systems

Identification For Control Based on Neural Networks: Approximately Linearizable Models

Direct data-driven state-feedback control of general nonlinear systems

Data-Driven Deep Learning Based Feedback Linearization of Systems with Unknown Dynamics

Meta results on data-driven control of nonlinear systems

Control of nonlinear systems: a model inversion approach

Learning Control-Oriented Dynamical Structure from Data

A System Level Approach to Discrete-Time Nonlinear Systems

Data-Driven Optimal Control Using Transfer Operators

Nonlinear system identification in coherence with nonlinearity measure for dynamic physical systems—case studies

[Surgery of superficial femoral artery and popliteal artery].