Hybrid linear-quadratic optimal control problem

Liping Pan

1995-01-01

Abstract:In this paper we proved that the linear-quadratic optimal control problem with hybrid performance index can be reduced to the standard case. Thus we obtained a feedback solution of the hybrid problem mentioned above by means of the standard linear-quadratic optimal control theory. The problem considered here is much more general than the problem discussed in [3].

What problem does this paper attempt to address?

Optimal Control for Hybrid Systems Based on Mixed Dynamic Programming

HF Zhai,HY Su,J Chu,WM Wu,HH Wu

DOI: https://doi.org/10.1109/wcica.2000.862442

2000-01-01

Abstract:In this paper, the model of hybrid systems restricted to time-deterministic discrete transitions is presented, and the quadratic optimal control problem for the hybrid systems is investigated using a new method, called the mixed dynamic programming method. The stability of the closed-loop hybrid systems is proved by the Lyapunov method. The proposed design approach is illustrated by a numerical example
Study on optimal control strategy for a class of piecewise linear hybrid systems

翟海峰,苏宏业,董利达,王肖,褚健

DOI: https://doi.org/10.3321/j.issn:1001-0920.2002.06.008

2002-01-01

Abstract:The model of hybrid systems restricted to time-deterministic discrete transitions is presented. The quadratic optimal control problem for the hybrid systems is investigated based on mixed dynamical programming methods. The stability of the closed-loop hybrid systems is proved by Lyapunov method. A numerical example illustrates the effectiveness of the design approach.
On Modeling and Optimal Control of a Class of Hybrid Systems

ZHANG Li-yan,XU Hua-zhong,QIAN Ji-xin

DOI: https://doi.org/10.3969/j.issn.1671-7848.2005.05.003

2005-01-01

Abstract:Optimal control of hybrid systems encounters the difficulty of computational complexity due to hybrid systems involving continuous variable and discrete variable.Hybrid model mixed with logics and rules is presented. Mixed integer nonlinear programming algorithm integrated constraint programming is applied to solve optimal control problems of hybrid model. The practical result shows that this method can build more precision model by utilizing mechanism model of industrial process and expert experience. And it also shows that the algorithm of mixed integer nonlinear programming integrated constraint programming can solve the optimal control problem of hybrid model rapidly. So this method can be used in real-time control of industrial process.
An Improved Smoothing Technique-Based Control Vector Parameterization Method for Optimal Control Problems with Inequality Path Constraints

Ping Liu,Xiangyu Li,Xinggao Liu,Yunqing Hu

DOI: https://doi.org/10.1002/oca.2273

2016-01-01

Optimal Control Applications and Methods

Abstract:An improved control vector parameterization (CVP) method is proposed to solve optimal control problems with inequality path constraints by introducing the l(1) exact penalty function and a novel smoothing technique. Both the state and control variables are allowed to appear explicitly in the inequality path constraints simultaneously. By applying the penalty function and smoothing technique, all the inequality path constraints are firstly reformulated as non-differentiable penalty terms and incorporated into the objective function. Then, the penalty terms are smoothed by using a novel smooth function, leading to a smooth optimal control problem with no inequality path constraints. With discretizing the control space, a corresponding nonlinear programming (NLP) problem is derived, and error between the NLP problem and the original problem is discussed. Results reveal that if the smoothing parameter is sufficiently small, the solution of the NLP problem is approximately equal to the original problem, which shows the convergence of the proposed method. After clarifying some theories of the proposed approach, a concomitant numerical algorithm is put forward with furnishing the updating rules of both the penalty parameter and smoothing parameter. Simulation examples verify the advantages of the proposed method for tackling nonlinear optimal control problems with different inequality path constraints. Copyright (c) 2016 John Wiley & Sons, Ltd.
Sequential Linear Quadratic Control of Bilinear Parabolic PDEs Based on POD Model Reduction

Chao Xu,Yongsheng Ou,Eugenio Schuster

DOI: https://doi.org/10.1016/j.automatica.2010.11.001

IF: 6.4

2011-01-01

Automatica

Abstract:We present a framework to solve a finite-time optimal control problem for parabolic partial differential equations (PDEs) with diffusivity-interior actuators, which is motivated by the control of the current density profile in tokamak plasmas. The proposed approach is based on reduced order modeling (ROM) and successive optimal control computation. First we either simulate the parabolic PDE system or carry out experiments to generate data ensembles, from which we then extract the most energetic modes to obtain a reduced order model based on the proper orthogonal decomposition (POD) method and Galerkin projection. The obtained reduced order model corresponds to a bilinear control system. Based on quasi-linearization of the optimality conditions derived from Pontryagin's maximum principle, and stated as a two boundary value problem, we propose an iterative scheme for suboptimal closed-loop control. We take advantage of linear synthesis methods in each iteration step to construct a sequence of controllers. The convergence of the controller sequence is proved in appropriate functional spaces. When compared with previous iterative schemes for optimal control of bilinear systems, the proposed scheme avoids repeated numerical computation of the Riccati equation and therefore reduces significantly the number of ODEs that must be solved at each iteration step. A numerical simulation study shows the effectiveness of this approach.
An Approximation for the Boundary Optimal Control Problem of a Heat Equation Defined in a Variable Domain

Yu Xin,Ren Zhi-Gang,Xu Chao

DOI: https://doi.org/10.1088/1674-1056/23/4/040201

2014-01-01

Chinese Physics B

Abstract:In this paper, we consider a numerical approximation for the boundary optimal control problem with the control constraint governed by a heat equation defined in a variable domain. For this variable domain problem, the boundary of the domain is moving and the shape of the boundary is defined by a known time-dependent function. By making use of the Galerkin finite element method, we first project the original optimal control problem into a semi-discrete optimal control problem governed by a system of ordinary differential equations. Then, based on the aforementioned semi-discrete problem, we apply the control parameterization method to obtain an optimal parameter selection problem governed by a lumped parameter system, which can be solved as a nonlinear optimization problem by a Sequential Quadratic Programming（SQP） algorithm. The numerical simulation is given to illustrate the effectiveness of our numerical approximation for the variable domain problem with the finite element method and the control parameterization method.
Robust Stabilization of Uncertain Hybrid Systems with Multiple Equilibria

张霓,吴铁军

DOI: https://doi.org/10.3785/j.issn.1008-973x.2002.03.012

2002-01-01

Abstract:The problem of robust stabilization for parametric uncertain hybrid systems with multiple equilibria was considered. Piecewise quadratic Lyapunov functions were applied to derive the sufficient conditions for hybrid state feedback robust stabilization. The proposed design of hybrid state feedback robust stabilization controllers is formulated as a convex problem in terms of linear matrix inequalities, which can be solved by relevant software.Controllability of the continuous time subsystems is not required since the controller design consists of discrete event dynamics design and continuous time dynamics design. The applicability of this design approach is shown a successfal simulation example.
Improved Control Using PFC and Modified Linear Quadratic Regulator for a Kind of Nonlinear Systems

Ridong Zhang,Renquan Lu,Shuqing Wang

DOI: https://doi.org/10.1080/00207721.2014.915352

IF: 2.648

2014-01-01

International Journal of Systems Science

Abstract:This paper describes the combination design of predictive functional control (PFC) and optimal linear quadratic (LQ) method for a kind of nonlinear process with output feedback coupling. In many existing control methods for this kind of nonlinear systems, the nonlinear part is either ignored or represented as a rough linear one when corresponding predictive control methods are designed. However, by assuming that the nonlinearity can be ignored or simplified to a linear time-varying part may not lead to the good control performance of subsequent linear control designs. The paper is a further investigation on this kind of systems, in which a procedure of PFC plus a modified optimal LQ control is developed. With respect to the proposed control strategy and the corresponding processes, the closed-loop performance is improved concerning tracking ability and disturbance rejection compared with previous predictive control methods. In addition, the proposed control is easy to implement as it selects a simple structure and a modification of the classical control scheme.
NEAR-OPTIMAL CONTROLS OF THE LINEAR-NONQUADRATIC OPTIMAL CONTROL PROBLEM

Pan Liping,Yu Xinhui

DOI: https://doi.org/10.3969/j.issn.1000-0577.2007.05.013

2007-01-01

Abstract:This paper gives a method to obtain the near-optimal controls of the so-called linear-nonquadratic optimal control problem.
Optimal control of a class of hybrid systems with states and inputs constraints

张聚,李平

DOI: https://doi.org/10.3785/j.issn.1008-973X.2003.02.003

2003-01-01

Abstract:Based on the discrete time mixed Logical Dynamical (MLD) model of hybrid systems, the Mixed Integer quadratic Programming (MIQP) approach for optimal control of hybrid systems with inputs and states constraints is studied. MIQP approach can easily deal with constraints which had to be satisfied because of the physical restrictions or for operation safety. A quadratic performance criterion is used, and the problem of constrained optimal control of hybrid systems is transformed into an MIQP problem. Different from that of the usual Quadratic Programming (QP) problem, some decision variables of the MIQP problem had to be constrained to be 0 or 1. Based on the Branch and Bound strategy and genetic algorithm respectively, procedures for solving an MIQP problem are discussed and a MATLAB program is developed as an MIQP solver. At the end of this paper, a numerical example is presented and computerized simulations show that the MIQP approach is an effective and promising method for optimal control of hybrid systems.
A hybrid model-based optimal control method for nonlinear systems using simultaneous dynamic optimization strategies

Chunyue Song,Bing Wu,Ping Li

DOI: https://doi.org/10.1016/j.jprocont.2012.02.013

IF: 3.951

2012-01-01

Journal of Process Control

Abstract:To improve the overall control performance of nonlinear systems, an optimal control method, based on the framework of hybrid systems, is proposed. Firstly, the nonlinear systems are approximated by a number of piecewise affine models which are produced by the nonlinear systems at the specified operating points, then the piecewise affine models are synthesized under the framework of hybrid systems, and an associated optimal control problem, in which decision variables involve not only admissible continuous control but also the scheduling of subsystem modes, is established. Secondly, the optimal control problem is transformed into a MIQP problem by discretization over the whole state space and admissible control space to obtain the numerical optimal solution. For speeding up the algorithm, the simultaneous method on finite elements is used to lower the dimensions of the MIQP problem. Consequently, a hybrid model-based MPC for nonlinear systems is designed, and the adverse effects of model mismatch resulted from simultaneous method is weakened by MPC strategy. Simulations and comparisons with soft-switching method, hard-switching method and MLD method, confirm that a satisfactory performance can be obtained using the presented approach. © 2012 Elsevier Ltd. All rights reserved.
Near Optimal Control for a Class of Stochastic Hybrid Systems.

Chunyue Song,Ping Li

DOI: https://doi.org/10.1016/j.automatica.2010.05.024

IF: 6.4

2010-01-01

Automatica

Abstract:To address a computationally intractable optimal control problem for a class of stochastic hybrid systems, this paper proposes a near optimal state feedback control scheme, which is constructed by using a statistical prediction method based on approximate numerical solution that samples over the entire state space. A numerical example illustrates the potential of the approach.
Analysis of linear‐quadratic optimal control via a hybrid control lens

Lechen Feng,Yuan‐Hua Ni

DOI: https://doi.org/10.1002/asjc.3551

IF: 2.4

2024-12-03

Asian Journal of Control

Abstract:Linear‐quadratic regulator (LQR) is a landmark problem in the field of optimal control, which is investigated based on the method of hybrid dynamic system and continuous‐time optimization algorithms. We show that the above‐mentioned hybrid system converges exponentially to the optimal feedback gain with any order, and the solution trajectory is Zeno‐free. Then, the forward‐Euler method is utilized to discretize the hybrid system, and a new algorithm called hybrid dynamics‐based gradient descent (HGD) is proposed that could converge to the optimal controller exponentially.

automation & control systems
A Hybrid Optimization Approach for Discrete-Time H<inf>&#x221E;</inf> Static-Output-feedback Control Problem

Feng Zhang,Li Xu,Zhentao Liu,Danyun Li

DOI: https://doi.org/10.1109/chicc.2015.7260071

2015-01-01

Abstract:Optimizing the coordinate transformation matrix is a newly proposed iterative LMI-based approach for solving the H ∞ static-output-feedback (SOF) control of discrete-time systems. Once a proper initial coordinate transformation matrix was found, a locally optimal solution for the H ∞ SOF control problem can be ensured. However, the problem of how to choose the initial matrix needs to be further studied. This paper applies a cone complementarity linearization (CCL) strategy to solve this problem. Then, a hybrid optimization approach is developed to solve the H ∞ SOF control problem. Finally, numerical examples are provided to demonstrate the effectiveness and advantages of the proposed method.
Mixed L-1/H-2/H-Infinity Control Design: Numerical Optimization Approaches

Daniel U. Campos-Delgado,Kemin Zhou

DOI: https://doi.org/10.1080/0020717031000105544

IF: 2.102

2003-01-01

International Journal of Control

Abstract:This paper presents some new approaches to mixed performance control problems of linear systems. The design techniques proposed in this paper are based on numerical search of the norm bounded stable transfer matrix Q in the H-infinity and H-2 suboptimal controller parameterizations so that the additional performance specifications are satisfied. The design problems are then converted to some finite dimensional non-linear unconstrained optimization problems by explicitly parameterizing the H-infinity or H-2 norm bounded stable transfer matrix Q for any fixed order. Finally, some two-stage optimization algorithms are applied to find the optimal parameters. Numerical examples have shown significant performance improvements of the proposed algorithms over those in the existing literature.
Optimal Nonlinear Feedback Control of Quasi-Hamiltonian Systems

Weiqiu Zhu,Zuguang Ying

DOI: https://doi.org/10.1007/bf02875989

1999-01-01

Science in China Series A Mathematics

Abstract:An innovative strategy for optimal nonlinear feedback control of linear or nonlinear stochastic dynamic systems is proposed based on the stochastic averaging method for quasi-Hamiltonian systems and stochastic dynamic programming principle. Feedback control forces of a system are divided into conservative parts and dissipative parts. The conservative parts are so selected that the energy distribution in the controlled system is as requested as possible. Then the response of the system with known conservative control forces is reduced to a controlled diffusion process by using the stochastic averaging method. The dissipative parts of control forces are obtained from solving the stochastic dynamic programming equation.
Uniformly Lipschitz Feedback Optimal Controls in A Linear-Quadratic Framework

Yashan Xu

DOI: https://doi.org/10.1016/j.jmaa.2006.04.029

IF: 1.417

2007-01-01

Journal of Mathematical Analysis and Applications

Abstract:A uniformly k-Lipschitz feedback optimal control problem is considered in a linear quadratic framework. The value function is derived by a comparison-based reasoning, via which a necessary condition to the existence of optimal solutions is obtained: optimal feedback controls must be linear.
Optimal H∞ output feedback control for a class of nonlinear systems

Meiqin Liu,Senlin Zhang,Zhen Fan,Weihua Sheng

2013-01-01

Abstract:This paper discusses optimal H∞ output feedback control using linear matrix inequalities for a class of systems with sector bounded nonlinearities. A unified model, which is the interconnection of a linear dynamic system and a sector bounded static nonlinear operator, is proposed to describe these systems. Based on the H∞ performance analysis of the closed-loop systems including the unified model and output feedback controller, the parameters of output controller are determined not only to guarantee global asymptotic stability of the closed-loop system without disturbances, but also to reduce the effect of external disturbance on the performance output to a minimal H∞ norm constraint. The nonlinear systems satisfying certain sector type constraints can be transformed into this unified model, and H∞ output feedback controllers are designed for these systems in a unified way. © 2013 TCCT, CAA.
Optimal Control of Hybrid Systems Based on Dynamic Programming

ZS Yin,P Li

DOI: https://doi.org/10.1109/acc.2001.945828

2002-01-01

Abstract:The optimization of hybrid systems is studied in the paper, dynamic programming based on reachable net is proposed. This method can get the optimum and reduce the computing effectively.
Linear Quadratic Optimal Control for Systems Governed by First-Order Hyperbolic Partial Differential Equations

Xiaomin Xue,Juanjuan Xu,Huanshui Zhang

DOI: https://doi.org/10.1007/s11424-024-3324-8

2024-02-29

Journal of Systems Science and Complexity

Abstract:This paper focuses on linear-quadratic (LQ) optimal control for a class of systems governed by first-order hyperbolic partial differential equations (PDEs). Different from most of the previous works, an approach of discretization-then-continuousization is proposed in this paper to cope with the infinite-dimensional nature of PDE systems. The contributions of this paper consist of the following aspects: 1) The differential Riccati equations and the solvability condition of the LQ optimal control problems are obtained via the discretization-then-continuousization method. 2) A numerical calculation way of the differential Riccati equations and a practical design way of the optimal controller are proposed. Meanwhile, the relationship between the optimal costate and the optimal state is established by solving a set of forward and backward partial difference equations (FBPDEs). 3) The correctness of the method used in this paper is verified by a complementary continuous method and the comparative analysis with the existing operator results is presented. It is shown that the proposed results not only contain the classic results of the standard LQ control problem of systems governed by ordinary differential equations as a special case, but also support the existing operator results and give a more convenient form of computation.

mathematics, interdisciplinary applications

Hybrid linear-quadratic optimal control problem

Optimal Control for Hybrid Systems Based on Mixed Dynamic Programming

Study on optimal control strategy for a class of piecewise linear hybrid systems

On Modeling and Optimal Control of a Class of Hybrid Systems

An Improved Smoothing Technique-Based Control Vector Parameterization Method for Optimal Control Problems with Inequality Path Constraints

Sequential Linear Quadratic Control of Bilinear Parabolic PDEs Based on POD Model Reduction

An Approximation for the Boundary Optimal Control Problem of a Heat Equation Defined in a Variable Domain

Robust Stabilization of Uncertain Hybrid Systems with Multiple Equilibria

Improved Control Using PFC and Modified Linear Quadratic Regulator for a Kind of Nonlinear Systems

NEAR-OPTIMAL CONTROLS OF THE LINEAR-NONQUADRATIC OPTIMAL CONTROL PROBLEM

Optimal control of a class of hybrid systems with states and inputs constraints

A hybrid model-based optimal control method for nonlinear systems using simultaneous dynamic optimization strategies

Near Optimal Control for a Class of Stochastic Hybrid Systems.

Analysis of linear‐quadratic optimal control via a hybrid control lens

A Hybrid Optimization Approach for Discrete-Time H&lt;inf&gt;&amp;#x221E;&lt;/inf&gt; Static-Output-feedback Control Problem

Mixed L-1/H-2/H-Infinity Control Design: Numerical Optimization Approaches

Optimal Nonlinear Feedback Control of Quasi-Hamiltonian Systems

Uniformly Lipschitz Feedback Optimal Controls in A Linear-Quadratic Framework

Optimal H∞ output feedback control for a class of nonlinear systems

Optimal Control of Hybrid Systems Based on Dynamic Programming

Linear Quadratic Optimal Control for Systems Governed by First-Order Hyperbolic Partial Differential Equations

A Hybrid Optimization Approach for Discrete-Time H<inf>∞</inf> Static-Output-feedback Control Problem