Stochastic Robustness Controller Design upon Different Ranking Criteria

Hao Wu,Yali Xue,Tingjin Ren

DOI: https://doi.org/10.1109/ICACC.2009.147

2009-01-01

Abstract:Managing the actions of several agents to perform tasks which require coordination and cooperation pose significant research challenges. One such challenge is to synchronize the agents’ view of the system to help them take the ‘right’ ...

What problem does this paper attempt to address?

Robust Controller Design for a Class of Time-Delay Systems with Nonlinear Uncertainties

SU Hongye,Shentu Weinong

2000-01-01

Abstract:Delay-dependent robust stability criterion and robust stabilization problem for a class of linear systems with time-varying norm-bounded nonlinear uncertainties and time-varying delayed state are studied.New robust stability criterion and a sufficient condition for the existence of memoryless robust stabilizing control law are derived.The delay-dependent results are given in terms of linear matrix inequality(LMI).
Robust stochastic control for networked bilateral teleoperation systems

Jian-Ning Li,Ya-Jun Pan,Trent Hilliard,Hongye Su

DOI: https://doi.org/10.3182/20130902-3-CN-3020.00028

2013-01-01

IFAC Proceedings Volumes

Abstract:In this paper, novel H∞ controllers are proposed for networked bilateral teleoperation system with time-varying delays and random packet losses. The manipulators are considered as parametric non-identical manipulators. The characteristic of network, such as random time-varying delays and packet losses are thoroughly incorporated in the design. For such systems, the mismatched-model terms are treated as disturbance, then, the model of closed-loop error dynamics are derived. By constructing novel time delay and packet loss dependent Lyapunov functionals, a sufficient condition is derived to ensure the exponentially mean square stability with a given disturbance attenuation level &gM. Experimental results show the effectiveness of the proposed modeling method and control scheme.
Robust Adaptive Control of a Class of Uncertain Nonlinear Systems

吴玉香,周东霞,胡跃明

2008-01-01

Abstract:Combining the adaptive Backstepping with the sliding mode control, we present a robust adaptive controller for a class of MIMO uncertain nonlinear systems. The model contains three forms of model uncertainty: 1) parametric uncertainty; 2) uncertainty in the input gains; 3) bounded uncertain functions which represent unmodelled dynamics and disturbances. The results of numerical simulation for the output tracking control of nonholonomic mobile manipulators are presented to demonstrate the effectiveness of the proposed approach.
A Comparative Study on Algorithms of Robust and Stochastic MPC for Uncertain Systems

Lan-Tao XIE,Lei XIE,Hong-Ye SU

DOI: https://doi.org/10.16383/j.aas.2017.c170082

2017-01-01

Abstract:In recent years,the development of model predictive control (MPC) of uncertain systems has been remarkable.This paper briefly reviews the development of robust MPC and stochastic MPC,summarizes their applications,and expounds and discusses the main algorithms of linear uncertain systems in these two fields.By summarizing their general models,the ways they work,computational complexities,and the ideas they use to ensure recursive feasibility and stability,we reveal the relationship of feasible sets among some of them and unravel the main features of these algorithms and their application situations.Finally,we demonstrate the performance of all the algorithms through certain simulation cases and give some indication on the future development of these two fields.
Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Hui Xiao,Zhihong Wei

2023-05-13

Abstract:This research considers the ranking and selection with input uncertainty. The objective is to maximize the posterior probability of correctly selecting the best alternative under a fixed simulation budget, where each alternative is measured by its worst-case performance. We formulate the dynamic simulation budget allocation decision problem as a stochastic control problem under a Bayesian framework. Following the approximate dynamic programming theory, we derive a one-step-ahead dynamic optimal budget allocation policy and prove that this policy achieves consistency and asymptotic optimality. Numerical experiments demonstrate that the proposed procedure can significantly improve performance.

Optimization and Control,Statistics Theory
Controlling Multivariable Systems with Significant Uncertainty

Qing-Guo Wang,You-Xian Sun,Chun-Hui Zhou

DOI: https://doi.org/10.1016/s1474-6670(17)54965-4

1988-01-01

Abstract:The problem of designing a robust controller for a multivariable system with significant uncertainty is considered. In particular, the class of uncertainty is represented by a set of finite demensional linear time-invariant models of the system. A physically realizable, finite demensional linear time-invariant controller in unit feedback configuration is designed such that the resulting feedback system simultaneously satisfies performance objectives for all models in the set. The performance objectives considered include not only stability but also regulation, tracking, weak interaction and desirable transcient behaviour. A new approach to a robust controller design which reaches the above objectives is developed in a frequency domain setting, and its effectiveness of this approach is verified by the design and simulation of a papermachine control system. The result exhibits quite satisfactory performances and strong robustness.
Stratified Game-Theoretic Optimization of Robust Control Design for Fuzzy Dynamical Systems: A Hybrid Nash–Stackelberg Strategy

Chenming Li,Chao Ma,Ye-Hwa Chen,Rongrong Yu

DOI: https://doi.org/10.1109/tsmc.2023.3344190

2024-03-19

IEEE Transactions on Systems Man and Cybernetics Systems

Abstract:In this article, the uncertain system parameters and disturbances are considered and described by fuzzy sets theory. Then, a new form of robust control is designed for the fuzzy dynamical systems. The system is proved to be uniformly bounded and uniformly ultimately bounded according to Lyapunov approach. To seek a better system performance and lower control cost, an optimization problem with multi parameters is formulated. A two-level game structure is proposed to find the optimal solution. First, the generalized Stackelberg game theory is applied when there are one leader and two followers. Then, the Nash game theory is applied for the two followers. Numerical simulations are performed for verification.

automation & control systems,computer science, cybernetics
Distributed Stabilization of Heterogeneous MASs in Uncertain Strong-Weak Competition Networks

Hong-Xiang Hu,Guanghui Wen,Xinghuo Yu,Zheng-Guang Wu,Tingwen Huang

DOI: https://doi.org/10.1109/tsmc.2020.3034765

2022-01-01

Abstract:Distributed stabilization problem is studied in this article for multiple heterogeneous agents in the uncertain strong-weak competition network with exogenous disturbances, where the agents are modeled by the second-order systems with different nonlinear intrinsic dynamics, and the network uncertainty is characterized by unknown nonzero parameters, which contains three different relationships among agents: 1) cooperation; 2) strong competition; and 3) weak competition. To achieve distributed stabilization, the whole network is first divided into two parts: 1) identifiable part and 2) unidentifiable part, and a new distributed robust integral sign of the error (RISE) controller is designed for each agent, where the selection rules of the corresponding parameters are given. It is shown that the heterogeneous multiagent system (MAS) can achieve distributed stabilization no matter whether the identifiable part is structurally balanced or not. Furthermore, it is proved that the global distributed stabilization is achieved for the heterogeneous agents provided that the partial derivatives of the nonlinear intrinsic dynamics are bounded. Finally, two numerical examples are given to demonstrate the effectiveness of the designed controller.
Robustness Of Non-Linear Stochastic Optimal Control For Quasi-Hamiltonian Systems With Parametric Uncertainty

yang wang,Z. G. Ying,W. Q. Zhu

DOI: https://doi.org/10.1080/00207720902989296

IF: 2.648

2009-01-01

International Journal of Systems Science

Abstract:The robustness of non-linear stochastic optimal control for quasi-Hamiltonian systems with uncertain parameters is studied. Based on the independence of uncertain parameters and stochastic excitations, the nonlinear stochastic optimal control for the nominal quasi-Hamiltonian system with average-value parameters is first obtained by using the stochastic averaging method and stochastic dynamical programming principle. Then, the means and standard deviations of root-mean-square responses, control effectiveness and control efficiency for the uncertain quasi-Hamiltonian system are calculated by using the stochastic averaging method and the probabilistic analysis. By introducing the sensitivity of the variation coefficients of controlled root-mean-square responses, control effectiveness and control efficiency to those of uncertain parameters, the robustness of the non-linear stochastic optimal control is evaluated. Two examples are given to illustrate the proposed control procedure and its robustness.
Approximate Policy Iteration for Robust Stochastic Control of Multi-agent Markov Decision Processes

Feng Huang,Ming Cao,Long Wang

DOI: https://doi.org/10.1109/tac.2024.3510596

IF: 6.549

2024-01-01

IEEE Transactions on Automatic Control

Abstract:In stochastic dynamic environments, multi-agent Markov decision processes have emerged as a versatile paradigm for studying sequential decision-making problems of fully cooperative multi-agent systems. However, the optimality of the derived policies is usually sensitive to model parameters, which are typically unknown and required to be estimated from noisy data in practice. To investigate the sensitivity of optimal policies to these uncertain parameters, we study a robust stochastic control problem of multi-agent Markov decision processes where all agents constitute a centralized controller whose goal is to seek a maximal long-term return of all agents and the uncertainty plays a role of disturbance for achieving this goal, and provide a solution concept of robust team optimality for decisions of all agents. To seek such a solution, we develop a robust iterative learning algorithm of policies for all agents and present its convergence analysis. This algorithm, compared with robust dynamic programming, not only possesses a faster convergence rate, but also allows for using approximation calculations to alleviate required computational resources. Moreover, some numerical simulations are presented to demonstrate the effectiveness of the algorithm by extending the model of sequential social dilemmas to uncertain scenarios.
Robust ${\cal H}_{\infty}$ Control for Networked Control Systems with Uncertainties and Multiple-Packet Transmission

Dongxiao Wu,Jun Wu,Sheng Chen

2010-01-01

Abstract:A class of networked control systems is investigated where the plant has time-varying norm-bounded parameter uncertainties, both the sensor-to-controller and controller to-actuator channels implement multiple-packet transmission and experience random packet dropouts. Suf?cient conditions for synthesis of robust stochastic stabilisation and design of robust H? controller are derived in the form of linear matrix inequalities. An example is provided to demonstrate the effectiveness of our proposed method.
Uncertain Robustness Optimization of Steam-Turbine Generator Set Control System

Hao Wu,Yali Xue,Tingjin Ren

DOI: https://doi.org/10.1109/iccee.2008.12

2008-01-01

Abstract:In order to meet the control specifications of thermal process with uncertainties, two uncertain robustness optimization methods are presented, utilizing stochastic and fuzzy theory. Fuzzy credibility robustness, based on newly developed fuzzy credibility theory, is a new concept other than probability robustness, which could provide more information. For the stochastic and fuzzy multi-objective programming problem respectively, NSGA-II algorithm combined with Monte-Carlo experiments are used to obtain the Pareto robustness solutions. Pessimistic value criterion is adopted to compare two uncertain variables. The above two methods are applied to a steam-turbine generator set control system optimization problem. Compared with those controller design methods based on nominal conditions, the results demonstrate the two new design methods have better robustness, and prove their feasibilities and advantages.
Optimal Control of Robust Team Stochastic Games

Feng Huang,Ming Cao,Long Wang

2021-01-01

Abstract:In stochastic dynamic environments, team stochastic games have emerged as a versatile paradigm for studying sequential decision-making problems of fully cooperative multiagent systems. However, the optimality of the derived policies is usually sensitive to the model parameters, which are typically unknown and required to be estimated from noisy data in practice. To mitigate the sensitivity of the optimal policy to these uncertain parameters, in this paper, we propose a model of “robust” team stochastic games, where players utilize a robust optimization approach to make decisions. This model extends team stochastic games to the scenario of incomplete information and meanwhile provides an alternative solution concept of robust team optimality. To seek such a solution, we develop a learning algorithm in the form of a Gauss-Seidel modified policy iteration and prove its convergence. This algorithm, compared with robust dynamic programming, not only possesses a faster convergence rate, but also allows for using approximation calculations to alleviate the curse of dimensionality. Moreover, some numerical simulations are presented to demonstrate the effectiveness of the algorithm by generalizing the game model of social dilemmas to sequential robust scenarios.
A Stackelberg Game-Theoretic Exploration Rendering Robustness and Optimality for Performance Improvement of Fuzzy Mechanical Systems

Rongrong Yu,Ye-Hwa Chen,Quanwei Wang

DOI: https://doi.org/10.1109/tcyb.2021.3091532

IF: 11.8

2021-01-01

IEEE Transactions on Cybernetics

Abstract:We consider mechanical systems with uncertainty. The uncertainty may be time varying. The bound of the uncertainty is described by its fuzzy characteristics. To design a feasible control, we start with a robust phase, which renders a control scheme that guarantees the system performance regardless of the actual value of the uncertainty. This robust phase is then followed by an optimal phase. There are design parameters in the control, which can be fine-tuned. We proposed multiple performance objectives. The goal of the choice of the control design parameters is to minimize the performance objectives. However, since these objectives are nonconciliating (meaning one's minimum is not the other one's minimum), we invoke the Stackelberg strategy for the optimal parameters. The game strategy mimics two players: one is the leader and one is the follower. Through the interplay between the two players, we show how to select the design parameters. The design procedure in both robust and optimal phases is demonstrated by a coupled inverted pendulum system.

automation & control systems,computer science, cybernetics, artificial intelligence
Distributed Robust Control of Linear Multi-Agent Systems with Parameter Uncertainties

Zhongkui Li,Zhisheng Duan,Lihua Xie,Xiangdong Liu

DOI: https://doi.org/10.1080/00207179.2012.674644

IF: 2.102

2012-01-01

International Journal of Control

Abstract:This article considers the distributed robust control problems of uncertain linear multi-agent systems with undirected communication topologies. It is assumed that the agents have identical nominal dynamics while subject to different norm-bounded parameter uncertainties, leading to weakly heterogeneous multi-agent systems. Distributed controllers are designed for both continuous- and discrete-time multi-agent systems, based on the relative states of neighbouring agents and a subset of absolute states of the agents. It is shown for both the continuous- and discrete-time cases that the distributed robust control problems under such controllers in the sense of quadratic stability are equivalent to the H ∞ control problems of a set of decoupled linear systems having the same dimensions as a single agent. A two-step algorithm is presented to construct the distributed controller for the continuous-time case, which does not involve any conservatism and meanwhile decouples the feedback gain design from the communication topology. Furthermore, a sufficient existence condition in terms of linear matrix inequalities is derived for the distributed discrete-time controller. Finally, the distributed robust H ∞ control problems of uncertain linear multi-agent systems subject to external disturbances are discussed.
Decentralized robust adaptive controller of modular stochastic control systems

Xiaobin Tan,Hongsheng Xi,Gang Wu,DeMin Sun

DOI: https://doi.org/10.1109/wcica.2000.863027

2000-01-01

Abstract:In this paper we study the decentralized robust adaptive tracking problem of control systems consisting of modular subsystems with stochastic input terms. A nonlinear control scheme for stochastic linear control system is proposed to design the direct adaptive controller for each modular stochastic subsystem. When the stochastic input terms satisfy some assumptions, we prove that the output tracking error of the closed-loop control systems is globally asymptotically bounded and can be guaranteed to converge to within the precision prescribed in actual problems in norm. At the end of the paper, an efficient decentralized control algorithm is employed to solve a simulative example.
Ranking and Selection as Stochastic Control

Yijie Peng,Edwin K. P. Chong,Chun-Hung Chen,Michael C. Fu

DOI: https://doi.org/10.1109/tac.2018.2797188

IF: 6.549

2018-08-01

IEEE Transactions on Automatic Control

Abstract:Under a Bayesian framework, we formulate the fully sequential sampling and selection decision in statistical ranking and selection as a stochastic control problem, and derive the associated Bellman equation. Using a value function approximation, we derive an approximately optimal allocation policy. We show that this policy is not only computationally efficient but also possesses both one-step-ahead and asymptotic optimality for independent normal sampling distributions. Moreover, the proposed allocation policy is easily generalizable in the approximate dynamic programming paradigm.

automation & control systems,engineering, electrical & electronic
Robust Adaptive Control of a Class of Nonlinear Uncertain Systems

Yu Zhu

2003-01-01

Abstract:A backstepping design procedure is proposed for a class of nonlinear system with unknown parameters and dynamic uncertainties. A robust adaptive control algorithm is derived by recursive design approach. It is proved that under some assumptions, the derived robust adaptive controller guarantees global stability of the closed system and global uniformly ultimate boundedness property for all states of the closed system. Finally a simulational example is presented and the result demonstrates the controller′s effectiveness and feasibilities.
Robust Stabilization and H∞ Control for Stochastic Systems with Parameter Uncertainty and Nonlinearity

Hao Zhang,Tianliang Zhang,Weihai Zhang,Hang Su

DOI: https://doi.org/10.23919/chicc.2019.8865353

2019-01-01

Abstract:This paper focuses on the problem of delay-dependent robust stochastic stabilization and H ∞ control for uncertain stochastic nonlinear systems. Uncertain parameters are time-varying, unknown and norm bounded, while delay terms is time-varying. Firstly, by choosing an appropriate Lyapunov-Krasovskii functional, the results of robustly stochastic stabilization are obtained. Secondly, an appropriate state feedback controller is presented, and the problem of H ∞ control is discussed. Compared with previous results, the main advantages of our paper lie in that the system under consideration is more general, and the obtained results are less conservative.
Distributed robust adaptive formation control of multi-agent systems with heterogeneous uncertainties and directed graphs

Wenlong Yang,Zongying Shi,Yisheng Zhong

DOI: https://doi.org/10.1016/j.automatica.2023.111275

IF: 6.4

2023-11-01

Automatica

Abstract:This paper studies distributed time-varying formation control problems for a class of linear systems with heterogeneous uncertainties and directed graphs. Both the cases without and with an active leader having unknown control inputs are considered. Two new robust adaptive formation protocols are designed in a totally distributed fashion, both of which incorporate two parts: a fully distributed nominal controller relying on the neighbors’ relative state information and an adaptive compensating signal to restrain the influences of uncertainties. An original adaptive compensating strategy is proposed herein to deal with uncertainties related to not only system states but also control inputs. On the basis of adaptive mechanism, the controller design requires neither global information about communication topologies nor the upper bounds of uncertainties and the leader’s control inputs. Based on Lyapunov arguments, sufficient conditions to achieve the desired formation are derived in terms of Riccati equations. The proposed protocols guarantee that the formation errors can converge to zero. Finally, the theoretical results are demonstrated by numerical simulations.

automation & control systems,engineering, electrical & electronic

Stochastic Robustness Controller Design upon Different Ranking Criteria

Robust Controller Design for a Class of Time-Delay Systems with Nonlinear Uncertainties

Robust stochastic control for networked bilateral teleoperation systems

Robust Adaptive Control of a Class of Uncertain Nonlinear Systems

A Comparative Study on Algorithms of Robust and Stochastic MPC for Uncertain Systems

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Controlling Multivariable Systems with Significant Uncertainty

Stratified Game-Theoretic Optimization of Robust Control Design for Fuzzy Dynamical Systems: A Hybrid Nash–Stackelberg Strategy

Distributed Stabilization of Heterogeneous MASs in Uncertain Strong-Weak Competition Networks

Robustness Of Non-Linear Stochastic Optimal Control For Quasi-Hamiltonian Systems With Parametric Uncertainty

Approximate Policy Iteration for Robust Stochastic Control of Multi-agent Markov Decision Processes

Robust ${\cal H}_{\infty}$ Control for Networked Control Systems with Uncertainties and Multiple-Packet Transmission

Uncertain Robustness Optimization of Steam-Turbine Generator Set Control System

Optimal Control of Robust Team Stochastic Games

A Stackelberg Game-Theoretic Exploration Rendering Robustness and Optimality for Performance Improvement of Fuzzy Mechanical Systems

Distributed Robust Control of Linear Multi-Agent Systems with Parameter Uncertainties

Decentralized robust adaptive controller of modular stochastic control systems

Ranking and Selection as Stochastic Control

Robust Adaptive Control of a Class of Nonlinear Uncertain Systems

Robust Stabilization and H∞ Control for Stochastic Systems with Parameter Uncertainty and Nonlinearity

Distributed robust adaptive formation control of multi-agent systems with heterogeneous uncertainties and directed graphs