Linear Control Of Live Marked Graphs

P Darondeau,X Xie

DOI: https://doi.org/10.1016/S0005-1098(02)00266-2

IF: 6.4

2003-01-01

Automatica

Abstract:Given a linear constraint on the firing vectors of a live marked graph with uncontrollable/unobservable transitions, bounded or unbounded, we apply linear programming techniques to compute the most liberal controller enforcing this constraint. (C) 2002 Elsevier Science Ltd. All rights reserved.

What problem does this paper attempt to address?

Combined Controller Synthesis forMarked Graphs

Ji-Liang LUO,WU Wei-Min,SU Hong-Ye,Jian Chu

DOI: https://doi.org/10.1360/aas-007-0218

2007-01-01

ACTA AUTOMATICA SINICA

Abstract:The exponential computation complexity of the state reachability analysis makes it difficult to apply forbidden state controller synthesis method to large plant nets. To solve this problem, a combined controller synthesis method is proposed for marked graphs. Firstly, the methods of designing observers are obtained. Secondly, the algorithm of calculating the maximally permissive control policy is proposed using the markings of the observers. The results show that the online computational efficiency of the controller is increased, because the state spaces to be observed is decreased in dimension number. Furthermore, the plant nets are not necessarily alive or bounded.
Control synthesis for a class of controlled Petri nets

weimin wu,hongye su,jian chu,haifeng zhai

DOI: https://doi.org/10.3182/20020721-6-es-1901.00526

2002-01-01

IFAC Proceedings Volumes

Abstract:Abstract This paper proposes a new control synthesis method for a class of discrete event systems modeled by controlled ordinary Petri nets with linear marking constraint. Monitor is constructed to track the system state resulted from the uncontrollable firing sequences. The maximally permissive feedback control policy then can be obtained based on the making of the monitor. No non-convex constraint transformation is introduced in the design procedure. The method is capable of synthesizing a class of net that cannot be treated using previous methods due to some necessary restrictions.
Constraint Function Based Hierarchical Control of Discrete Event Systems

Yu Ru,Weimin Wu,Hongye Su,Jian Chu

DOI: https://doi.org/10.1109/wcica.2004.1340774

2004-01-01

Abstract:Due to the introduction of uncontrollable transitions in the supervisory control of discrete event systems modeled by controlled Petri nets, a disjunction of several linear inequalities is needed to express the admissible markings. In this paper, we propose a two level hierarchical control synthesis method to deal with this kind of OR logic constraints. In the method, the constraint function plays an important role not only in the construction of the low level monitor but also in the determination of the control policy. The obtained supervisor is maximally permissive and the online computation has the complexity of polynomial times. An example is used to illustrate the proposed synthesis algorithm.
Feedback Control Logic for Forbidden-State Problems of Marked Graphs: Application to a Real Manufacturing System.

A Ghaffari,N Rezg,XL Xie

DOI: https://doi.org/10.1109/tac.2002.806651

IF: 6.549

2003-01-01

IEEE Transactions on Automatic Control

Abstract:This paper addresses the forbidden-state problem of general marked graphs with uncontrollable transitions. The models need not to be safe nor cyclic. Control requirements are expressed as the conjunction of general mutual exclusion constraints (GMEC) of markings of so-called critical places. Structural properties such as influence paths and influence zones are proposed to perform the worst-case analysis for each GMEC specification with any given initial marking when only uncontrollable transitions are allowed. Efficient solutions are proposed for the determination of the maximal uncontrollably reachable marking of any critical place, and this for many possible, more or less general, configurations of the net structure, even for the case of overlapping paths of critical places. Besides, we demonstrate that these results can be easily extended to unbounded nets and when critical places have negative weights. For the most general case, when analytical solution is not available, a linear programming approach is proposed. The great advantage of the proposed approach over existing methods is emphasized by using it to solve the supervisory control problem of the automated manufacturing system of Atelier Inter-etablissements de Productique Rhone Alpes Ouest (AIP-RAO); Lyon, France.
Synthesis of Petri nets controller for the constraints involving marking vector and Parikh vector

Wang Shouguang,Yan Gangfeng

DOI: https://doi.org/10.1109/ICSMC.2004.1399877

2004-01-01

Abstract:The problem of enforcing linear inequality constraints involving the marking vector and the Parikh vector on a discrete event system (DES) modeled by Petri nets (PN) is discussed in this paper. A novel method for design of controller enforcing the constraints is presented. First the constraints involving the marking and the Parikh vector are transformed into the constraints involving Parikh vector only, and then the controller is constructed based on the viewpoint that a place can be seen as a linear inequality constraint on Parikh vector. The method is proved to be simpler and more efficient than the method presented by Iordache and Moody through an applied instance that was also cited by Moody et al., and holds remarkable advantage especially for large systems.
A Method for the Design of Petri Net Controller Enforcing General Linear Constraints

WANG Shou-Guang,YAN Gang-feng

DOI: https://doi.org/10.1360/jos160419

2005-01-01

Journal of Software

Abstract:The problem of constructing a Petri net feedback controller, which enforces linear inequality constraints involving the marking vector and the Parikh vector on a discrete event system (DES) modeled by Petri nets (PN), is discussed in this paper. A novel method for design of controller enforcing the constraints is presented. First the constraints involving the marking and Parikh vectors are transformed into the constraints involving Parikh vector only using Petri net state equality, and then the controller is constructed based on the viewpoint that a place can be seen as a linear inequality constraint on the Parikh vector. The method is proved to be simpler and more efficient than that presented by Iordache and Moody through an applied instance that was also used by Moody et al., and holds remarkable advantage especially for large systems.
State Feedback Control of Discrete Event Systems Using Marked Graphs

A Ghaffari,N Rezg,X Xie

DOI: https://doi.org/10.1109/.2001.981002

2002-01-01

Abstract:Addresses the state feedback control of marked graphs with uncontrollable transitions and forbidden states. Control requirements are expressed as the conjunction of general mutual exclusion constraints (GMEC) of markings of so-called critical places. Structural properties such as influence paths and influence zones are defined to perform the worst-case analysis for each GMEC specification with any given initial marking when only uncontrollable transitions are allowed. A simple analytical solution of the maximal uncontrollably reachable marking of any critical place is proposed. It is then extended to paths of critical places. We further distinguish the case where critical places are independent. We prove that the worst-case marking of a GMEC specification of independent critical places corresponds to the worst-case marking of each critical place.
Synthesis of supervisor enforcing Parikh constraints with uncontrollable transitions in Petri Nets

Yao-yao ZHANG,Gang-feng YAN,Sen-lin ZHANG,Mei-qin LIU

DOI: https://doi.org/10.3785/j.issn.1008-973X.2006.07.005

2006-01-01

Abstract:A detailed analysis of supervisory control with Parikh vector constraints for Petri Net based discrete event systems with uncontrollable transitions. Constraints were divided into controllable part and uncontrollable part, which can be called admissible and forbidden constraints. Matrix-Transformation method was proposed to transform the forbidden constraint into admissible one to obtain the controller. Through examples, the method given here was proved to be clear in structure and concise in computation, and would greatly simplify controller synthesis when applied to constraints in complex Petri Net.
Networked guaranteed cost control for uncertain discrete-time markovian jump linear systems

Shanbin Li,Youxian Sun

2008-01-01

Abstract:This paper addresses the networked guaranteed cost control for discrete-time jump linear systems governed by two different Markov chains which represent the uncertain transition probability of open-loop plant and the random network-induced effects respectively. A new sufficient condition for the existence of guaranteed cost controller and an upper bound of the cost function are presented by a stochastic Lyapunov-Krasovskii functional. The mode-dependent controller design problem for such system is then formulated as a convex optimization over a set of linear matrix inequalities (LMIs). As an example to verify the proposed method, a class of open-loop unstable plants in the networked setup is discussed. The simulation results demonstrate the effectiveness of the method. Copyright © 2008 Watam Press.
Petri Net Based Supervisor For Hybrid-Logic Linear Constraints

Yaoyao Zhang,Gangfeng Yan,Meiqin Liu

2006-01-01

Abstract:A novel extended Petri Net, Critical Arc Petri Net, is proposed in this paper to simplify the controller synthesis for hybrid-logic linear constraints, which can test negative marking when negative tokens are allowed in places. A supervisor, based on extended Petri Nets, is proposed to deal with hybrid-logic constraints including AND-logic and OR-logic constraints. In supervisor synthesis, the first step is to apply P-invariant method to obtain constraint controller for each single constraint, and the second step is to design logic controller based on extended Petri Nets. At the end of the paper, an example is provided to illustrate the procedure of supervisor synthesis.
Chain Controllability of Linear Control Systems

Fritz Colonius,Alexandre J. Santana,Eduardo C. Viscovini

DOI: https://doi.org/10.1137/23m1626347

IF: 2.2

2024-08-21

SIAM Journal on Control and Optimization

Abstract:SIAM Journal on Control and Optimization, Volume 62, Issue 4, Page 2387-2411, August 2024. For linear control systems with bounded control range, chain controllability properties are analyzed. It is shown that there exists a unique chain control set and that it equals the sum of the control set around the origin and the center Lyapunov space of the homogeneous part. For the proof, the linear control system is extended to a bilinear control system on an augmented state space. This system induces a control system on projective space. For the associated control flow, attractor-repeller decompositions are used to show that the control system on projective space has a unique chain control set that is not contained in the equator. It is given by the image of the chain control set of the original linear control system.

mathematics, applied,automation & control systems
Joint Chance Constrained Optimal Control via Linear Programming

Niklas Schmid,Marta Fochesato,Tobias Sutter,John Lygeros

2024-05-18

Abstract:We establish a linear programming formulation for the solution of joint chance constrained optimal control problems over finite time horizons. The joint chance constraint may represent an invariance, reachability or reach-avoid specification that the trajectory must satisfy with a predefined probability. For finite state and action spaces, the solution is exact and our method computationally superior to approaches in the literature. For continuous state or action spaces, our linear programming formulation enables basis function approximations.

Optimization and Control,Systems and Control
Dynamic Programming for Controlled Markov Families: Abstractly and over Martingale Measures

Gordan Žitković,Gordan Žitković

DOI: https://doi.org/10.1137/130926481

IF: 2.2

2014-01-01

SIAM Journal on Control and Optimization

Abstract:We describe an abstract control-theoretic framework in which the validity of the dynamic programming principle can be established in continuous time by a verification of a small number of structural properties. As an application we treat several cases of interest, most notably the lower-hedging and utility-maximization problems of financial mathematics, both of which are naturally posed over sets of martingale measures.

mathematics, applied,automation & control systems
Graphon Control of Large-scale Networks of Linear Systems

Shuang Gao,Peter E. Caines

DOI: https://doi.org/10.1109/TAC.2019.2955976

2019-11-24

Abstract:To achieve control objectives for extremely large-scale complex networks using standard methods is essentially intractable. In this work a theory of the approximate control of complex network systems is proposed and developed by the use of graphon theory and the theory of infinite dimensional systems. First, graphon dynamical system models are formulated in an appropriate infinite dimensional space in order to represent arbitrary-size networks of linear dynamical systems, and to define the convergence of sequences of network systems with limits in the space. Exact controllability and approximate controllability of graphon dynamical systems are then investigated. Second, the minimum energy state-to-state control problem and the linear quadratic regulator problem for systems on complex networks are considered. The control problem for graphon limit systems is solved in each case and approximations are defined which yield control laws for the original control problems. Furthermore, convergence properties of the approximation schemes are established. A systematic control design methodology is developed within this framework. Finally, numerical examples of networks with randomly sampled weightings are presented to illustrate the effectiveness of the graphon control methodology.

Optimization and Control
Model Predictive Control Synthesis for Constrained Markovian Jump Linear Systems with Bounded Disturbance

Jianbo Lu,Yugeng Xi,Dewei Li,Yuli Xu,Zhongxue Gan

DOI: https://doi.org/10.1049/iet-cta.2017.0406

2017-01-01

Abstract:For controller design, exogenous disturbance, which commonly exists in real applications, is an important factor to be considered. However, the existing results on constrained model predictive control (MPC) design for Markovian jump linear systems (MJLS) mainly focused on the disturbance-free case. This motivated to study constrained MPC synthesis for MJLS with bounded additive disturbance. By projecting the desired closed loop trajectories onto a set of predetermined trajectories, the adopted predictive control law is a sum of these corresponding stabilising control laws. Constraints are guaranteed by restricting the augmented state into a maximal output admissible set. Then the MPC algorithm is given by optimising the infinite horizon sum of deviation of the quadratic cost from its steady-state value. Under the MPC algorithm, the long run average cost is proved to be less than or equal to its steady-state value, which equals to the optimal one when one of the constituent control laws is chosen to be the optimal control law. The optimisation and analysis of determination of projection coefficients have also been discussed. Finally, a numerical example is given to illustrate the proposed results.
Data-driven optimal control via linear programming: boundedness guarantees

Lucia Falconi,Andrea Martinelli,John Lygeros

2023-10-30

Abstract:The linear programming (LP) approach is, together with value iteration and policy iteration, one of the three fundamental methods to solve optimal control problems in a dynamic programming setting. Despite its simple formulation, versatility, and predisposition to be employed in model-free settings, the LP approach has not enjoyed the same popularity as the other methods. The reason is the often poor scalability of the exact LP approach and the difficulty to obtain bounded solutions for a reasonable amount of constraints. We mitigate these issues here, by investigating fundamental geometric features of the LP and developing sufficient conditions to guarantee finite solutions with minimal constraints. In the model-free context, we show that boundedness can be guaranteed by a suitable choice of dataset and objective function.

Systems and Control
Risk-sensitive control, single controller games and linear programming

Vivek Shripad Borkar

DOI: https://doi.org/10.48550/arXiv.2310.17277

2023-10-26

Optimization and Control

Abstract:This article recalls the recent work on a linear programming formulation of infinite horizon risk-sensitive control via its equivalence with a single controller game, using a classic work of Vrieze. This is then applied to a constrained risk-sensitive control problem with a risk-sensitive cost and risk-sensitive constraint. This facilitates a Lagrange multiplier based resolution thereof. In the process, this leads to an unconstrained linear program and its dual, parametrized by a parameter that is a surrogate for Lagrange multiplier. This also opens up the possibility of a primal - dual type numerical scheme wherein the linear program is a subroutine within the subgradient ascent based update rule for the Lagrange multiplier. This equivalent unconstrained risk-sensitive control formulation does not seem obvious without the linear programming equivalents as intermediaries. We also discuss briefly other related algorithmic possibilities for future research.
Structural Controllability on Graphs for Drifted Bilinear Systems over Lie Groups

Xing Wang,Bo Li,Jr-Shin Li,Ian R. Petersen,Guodong Shi

DOI: https://doi.org/10.48550/arXiv.2103.12915

2021-03-24

Abstract:In this paper, we study graphical conditions for structural controllability and accessibility of drifted bilinear systems over Lie groups. We consider a bilinear control system with drift and controlled terms that evolves over the special orthogonal group, the general linear group, and the special unitary group. Zero patterns are prescribed for the drift and controlled dynamics with respect to a set of base elements in the corresponding Lie algebra. The drift dynamics must respect a rigid zero-pattern in the sense that the drift takes values as a linear combination of base elements with strictly non-zero coefficients; the controlled dynamics are allowed to follow a free zero pattern with potentially zero coefficients in the configuration of the controlled term by linear combination of the controlled base elements. First of all, for such bilinear systems over the special orthogonal group or the special unitary group, the zero patterns are shown to be associated with two undirected or directed graphs whose connectivity and connected components ensure structural controllability/accessibility. Next, for bilinear systems over the special unitary group, we introduce two edge-colored graphs associated with the drift and controlled zero patterns, and prove structural controllability conditions related to connectivity and the number of edges of a particular color.

Optimization and Control
Constraint Handling in Continuous-Time DDP-Based Model Predictive Control

Jean-Pierre Sleiman,Farbod Farshidian,Marco Hutter

DOI: https://doi.org/10.48550/arXiv.2101.06067

2021-03-26

Abstract:The Sequential Linear Quadratic (SLQ) algorithm is a continuous-time variant of the well-known Differential Dynamic Programming (DDP) technique with a Gauss-Newton Hessian approximation. This family of methods has gained popularity in the robotics community due to its efficiency in solving complex trajectory optimization problems. However, one major drawback of DDP-based formulations is their inability to properly incorporate path constraints. In this paper, we address this issue by devising a constrained SLQ algorithm that handles a mixture of constraints with a previously implemented projection technique and a new augmented-Lagrangian approach. By providing an appropriate multiplier update law, and by solving a single inner and outer loop iteration, we are able to retrieve suboptimal solutions at rates suitable for real-time model-predictive control applications. We particularly focus on the inequality-constrained case, where three augmented-Lagrangian penalty functions are introduced, along with their corresponding multiplier update rules. These are then benchmarked against a relaxed log-barrier formulation in a cart-pole swing up example, an obstacle-avoidance task, and an object-pushing task with a quadrupedal mobile manipulator.

Robotics,Systems and Control,Optimization and Control
Linear quadratic differential game problems with constrained open-loop controls

Yashan Xu

DOI: https://doi.org/10.1109/CHICC.2008.4605667

2008-01-01

Abstract:Recently it is established that the finiteness of the open-loop value of a two-player zero-sum linear quadratic differential game is equivalent to the finiteness of its open-loop lower and upper values (P. Zhang, SIAM J. Control Optim., 43(2005), pp. 2157-2165). In this paper we discuss the case that the control sets are restricted in some elliptic regions, under which the linear operator method fails. By studying a two-point boundary value problem and the necessary conditions for an extremum, we prove that the value of the game exists if and only if both the upper and lower values of the unconstrained problem exist, which implies the results of Zhang. Further, the expression of the value function is obtained.

Linear Control Of Live Marked Graphs

Combined Controller Synthesis forMarked Graphs

Control synthesis for a class of controlled Petri nets

Constraint Function Based Hierarchical Control of Discrete Event Systems

Feedback Control Logic for Forbidden-State Problems of Marked Graphs: Application to a Real Manufacturing System.

Synthesis of Petri nets controller for the constraints involving marking vector and Parikh vector

A Method for the Design of Petri Net Controller Enforcing General Linear Constraints

State Feedback Control of Discrete Event Systems Using Marked Graphs

Synthesis of supervisor enforcing Parikh constraints with uncontrollable transitions in Petri Nets

Networked guaranteed cost control for uncertain discrete-time markovian jump linear systems

Petri Net Based Supervisor For Hybrid-Logic Linear Constraints

Chain Controllability of Linear Control Systems

Joint Chance Constrained Optimal Control via Linear Programming

Dynamic Programming for Controlled Markov Families: Abstractly and over Martingale Measures

Graphon Control of Large-scale Networks of Linear Systems

Model Predictive Control Synthesis for Constrained Markovian Jump Linear Systems with Bounded Disturbance

Data-driven optimal control via linear programming: boundedness guarantees

Risk-sensitive control, single controller games and linear programming

Structural Controllability on Graphs for Drifted Bilinear Systems over Lie Groups

Constraint Handling in Continuous-Time DDP-Based Model Predictive Control

Linear quadratic differential game problems with constrained open-loop controls