Stochastic Optimal Time-Delay Control of Quasi-Integrable Hamiltonian Systems

Ju Feng,Weiqiu Zhu,Бо Лю

DOI: https://doi.org/10.1016/j.cnsns.2010.11.020

IF: 4.186

2011-01-01

Communications in Nonlinear Science and Numerical Simulation

Abstract:National Science Foundation of China [10932009, 11072212]; Zhejiang Provincial Natural Science Foundation [Y7080070]

What problem does this paper attempt to address?

Stochastic Minimax Optimal Time-Delay State Feedback Control of Uncertain Quasi-Integrable Hamiltonian Systems

Ju Feng,Zu-Guang Ying,Yong Wang,Wei-Qiu Zhu

DOI: https://doi.org/10.1007/s00707-011-0530-y

IF: 2.645

2011-01-01

Acta Mechanica

Abstract:A stochastic minimax optimal time-delay state feedback control strategy for uncertain quasi-integrable Hamiltonian systems is proposed. First, a stochastic optimal state feedback control problem of uncertain quasi-integrable Hamiltonian system with time delay in feedback control subjected to Gaussian white noise is formulated. Then, the time-delayed state feedback control forces are approximated by the control forces without time delay and the original problem is converted into a stochastic optimal state feedback control problem of an uncertain system without time delay. After that, by following a procedure based on the stochastic averaging method and stochastic differential game, the worst-case disturbances and the optimal controls are obtained from solving a Hamiltonian–Jacobi–Isaacs (HJI) equation. As an example, the stochastic minimax optimal state feedback control of a Duffing oscillator with parametric disturbances and time-delayed feedback control is worked out in detail to illustrate the procedure and effectiveness of the proposed control strategy.
Optimal Guaranteed Cost Control for a Class of Linear Uncertain Time-Delay Systems

PG Jiang,HY Su,J Chu

DOI: https://doi.org/10.1109/wcica.2000.863157

2000-01-01

Abstract:Studies the optimal guaranteed control problem for a class of linear uncertain time-delay systems. The systems under consideration are described by state differential equations with time-varying unknown but norm-bounded uncertain parameters and time-varying unknown but bounded delay in states. An upper bound of the performance measured by standard quadratic function is constructed and based on the delay-dependent stabilizing approach, a method of designing a state feedback robust quadratic stabilizing control law guaranteeing this quadratic performance index be less than the constructed upper bound is derived. A procedure is given to select an optimal state feedback controller in the sense of minimizing this upper bound of the quadratic performance index. The results depend on the size of delay and are given in terms of several linear matrix inequalities
Stochastic Fractional Optimal Control of Quasi-Integrable Hamiltonian System with Fractional Derivative Damping

F. Hu,W. Q. Zhu,L. C. Chen

DOI: https://doi.org/10.1007/s11071-012-0547-3

IF: 6.549

2013-01-01

IEEE Transactions on Automatic Control

Abstract:In the present survey, some progress in the stochastic dynamics and fractional optimal control of quasi integrable Hamiltonian systems with fractional derivative damping is reviewed. First, the stochastic averaging method for quasi integrable Hamiltonian systems with fractional derivative damping under various random excitations is briefly introduced. Then, the stochastic stability, stochastic bifurcation, first passage time and reliability, and stochastic fractional optimal control of the systems studied by using the stochastic averaging method are summarized. The focus is placed on the effects of fractional derivative order on the dynamics and control of the systems. Finally, some possible extensions are pointed out.
Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

X. D. Gu,W. Q. Zhu,W. Xu

DOI: https://doi.org/10.1007/s11071-012-0494-z

IF: 5.741

2012-01-01

Nonlinear Dynamics

Abstract:A new procedure for designing optimal control of quasi non-integrable Hamiltonian systems under stochastic excitations is proposed based on the stochastic averaging method for quasi non-integrable Hamiltonian systems and the stochastic maximum principle. First, the control problem consisting of 2n-dimensional equations governing the controlled quasi non-integrable system and performance index is converted into a partially averaged one consisting of one-dimensional equation of the controlled system and performance index by using the stochastic averaging method. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The optimal control forces are determined from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is a stationary process and the FBSDE is reduced to a partial differential equation. Finally, the response statistics of optimally controlled system is predicted by solving the Fokker–Plank equation (FPE) associated with the fully averaged Itô equation of the controlled system. An example of two degree-of-freedom (DOF) quasi non-integrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness.
Robust Stabilizing Control for Uncertain Time-Delay Systems with Output Feedback

Hongye Su,Jian Chu,Jingcheng Wang,Shuqing Wang,Li Yu

DOI: https://doi.org/10.1016/S1474-6670(17)43154-5

1997-01-01

IFAC Proceedings Volumes

Abstract:This paper deals with the problem of robustly stabilizing linear time-varying uncertain systems with delayed state when the full state can not be measured. A dynamic output feedback controller is derived to quadratically stabilize the linear time-delay system with norm-bounded uncertainty via introducing a linear delay-free state observer. A sufficient condition for the robust output feedback stabilizability of the system is presented and the control law can be constructed by solving two algebraic Riccati equations A numerical example is presented to illustrate the obtained results
Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

R. H. Huan,Z. G. Ying,W. L. Jin,W. Q. Zhu

DOI: https://doi.org/10.1016/j.probengmech.2010.01.007

IF: 2.954

2010-01-01

Probabilistic Engineering Mechanics

Abstract:A minimax optimal control strategy for uncertain quasi-integrable Hamiltonian systems with time-delayed bounded feedback control is proposed. First, a quasi-integrable Hamiltonian system with time-delayed bounded control forces and uncertain excitation and system parameters is converted into a set of Itô stochastic differential equations without time delay. Then, the partially averaged Itô stochastic differential equations for the energy processes are derived by using the stochastic averaging method for quasi-integrable Hamiltonian systems. For these equations together with an appropriate performance index, a worst-case optimal control strategy is derived via solving a stochastic differential game problem. The worst-case disturbances and the optimal bounded controls are obtained by solving a Hamilton–Jacobi–Isaacs (HJI) equation. Finally, two examples are worked out in detail to illustrate the application and effectiveness of the proposed method.
Optimal bounded control of quasi non-integrable Hamiltonian systems

WQ Zhu,ML Deng

2003-01-01

Abstract:The optimal bounded control of quasi non-integrable Hamiltonian systems (multi-degree-of-freedom non-integrable Hamiltonian systems subject to light dampings and weakly random excitations) for minimizing their response is investigated. The equations of motion of a controlled quasi non-integrable Hamiltonian system is first reduced to an averaged Ito stochastic differential equation for the Hamiltonian by using the stochastic averaging method for quasi non-integrable Hamiltonian systems. Then, a dynamical programming equation for the control problem of minimizing response is formulated. The optimal control law is derived from the dynamical programming equation and the control constraints. Finally, the response of optimally controlled system is predicted from solving the Fokker-Planck-Kolmogrov (FPK) equation associated with completely averaged lto equation. An example is worked out to illustrate the application and effectiveness of the proposed control strategy.
A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Z. G. Ying,W. Q. Zhu

DOI: https://doi.org/10.12989/sem.2009.31.5.621

2009-01-01

Abstract:The time delay in active and semi-active controls is an important research subject. Many researches on the time-delay control for deterministic systems have been made (Hu and Wang 2002, Yang el al. 1990, Abdel-Mooty and Roorda 1991, Pu 1998, Cai and Huang 2002), while the study on that for stochastic systems is very limited. The effects of the time delay on the control of nonlinear systems under Gaussian white noise excitations have been studied by Bilello et al. (2002). The controlled linear systems with deterministic and random time delay subjected to Gaussian white noise excitations have been treated by Grigoriu (1997). Recently, a stochastic averaging method for quasi-integrable Hamiltonian systems with time delay has been proposed (Liu and Zhu 2007). In the present paper, a stochastic optimal time-delay control method for stochastically excited nonlinear structural systems is proposed based on the stochastic, averaging method for quasi Hamiltonian systems with time delay and the stochastic dynamical,, programming principle. An example of stochastically excited and controlled hysteretic column is given to illustrate the proposed control method.
Compensation for Time-Delayed Feedback Bang-Bang Control of Quasi-Integrable Hamiltonian Systems

W. Q. Zhu,Z. H. Liu

DOI: https://doi.org/10.1007/s11071-006-9101-5

2009-01-01

Abstract:The stochastic averaging method for quasi-integrable Hamiltonian systems with time-delayed feedback bang-bang control is first introduced. Then, two time delay compensation methods, namely the method of changing control force amplitude (CFA) and the method of changing control delay time (CDT), are proposed. The conditions applicable to each compensation method are discussed. Finally, an example is worked out in detail to illustrate the application and effectiveness of the proposed methods and the two compensation methods in combination.
Optimal Bounded Control of First-Passage Failure of Quasi-Integrable Hamiltonian Systems with Wide-Band Random Excitation

W. Q. Zhu,M. L. Deng,Z. L. Huang

DOI: https://doi.org/10.1023/A:1026049216559

IF: 5.741

2003-01-01

Nonlinear Dynamics

Abstract:The optimal bounded control of quasi-integrable Hamiltonian systems with wide-band random excitation for minimizing their first-passage failure is investigated. First, a stochastic averaging method for multi-degrees-of-freedom (MDOF) strongly nonlinear quasi-integrable Hamiltonian systems with wide-band stationary random excitations using generalized harmonic functions is proposed. Then, the dynamical programming equations and their associated boundary and final time conditions for the control problems of maximizinig reliability and maximizing mean first-passage time are formulated based on the averaged Itô equations by applying the dynamical programming principle. The optimal control law is derived from the dynamical programming equations and control constraints. The relationship between the dynamical programming equations and the backward Kolmogorov equation for the conditional reliability function and the Pontryagin equation for the conditional mean first-passage time of optimally controlled system is discussed. Finally, the conditional reliability function, the conditional probability density and mean of first-passage time of an optimally controlled system are obtained by solving the backward Kolmogorov equation and Pontryagin equation. The application of the proposed procedure and effectiveness of control strategy are illustrated with an example.
Optimal Control Strategies for Stochastically Excited Quasi Partially Integrable Hamiltonian Systems

Ronghua Huan,Maolin Deng,Weiqiu Zhu

DOI: https://doi.org/10.1007/s10409-007-0079-0

2007-01-01

Abstract:In this paper two different control strategies designed to alleviate the response of quasi partially integrable Hamiltonian systems subjected to stochastic excitation are proposed. First, by using the stochastic averaging method for quasi partially integrable Hamiltonian systems, an n -DOF controlled quasi partially integrable Hamiltonian system with stochastic excitation is converted into a set of partially averaged Itô stochastic differential equations. Then, the dynamical programming equation associated with the partially averaged Itô equations is formulated by applying the stochastic dynamical programming principle. In the first control strategy, the optimal control law is derived from the dynamical programming equation and the control constraints without solving the dynamical programming equation. In the second control strategy, the optimal control law is obtained by solving the dynamical programming equation. Finally, both the responses of controlled and uncontrolled systems are predicted through solving the Fokker-Plank-Kolmogorov equation associated with fully averaged Itô equations. An example is worked out to illustrate the application and effectiveness of the two proposed control strategies.
Stochastic Optimal Control of Quasi Integrable Hamiltonian Systems Subject to Actuator Saturation

R. H. Huan,W. Q. Zhu

DOI: https://doi.org/10.1177/1077546307086893

IF: 2.633

2009-01-01

Journal of Vibration and Control

Abstract:A modified bounded optimal control strategy for quasi integrable Hamiltonian systems subject to actuator saturation is proposed. First, an n degree-of-freedom (DOF) weakly controlled quasi Hamiltonian system subject to Gaussian white noise excitation is formulated and converted into Itô equations by adding Wong-Zakai correction terms. Then, the averaged Itô stochastic differential equations and dynamical programming equation are derived by using stochastic averaging method and the stochastic dynamical programming principle, respectively. The optimal control law consisting of unbounded optimal control and bounded bang-bang control is obtained from solving the dynamical programming equation. Finally, an example of a two DOF controlled quasi integrable Hamiltonian system is worked out in detail. Numerical results show that the proposed control strategy has high control effectiveness and efficiency and the chattering is reduced significantly comparing with bang-bang control strategy.
Stochastic Optimal Control for the Response of Quasi Non-Integrable Hamiltonian Systems

ML Deng,MC Hong,WQ Zhu

DOI: https://doi.org/10.3969/j.issn.0254-7805.2004.01.001

2003-01-01

Acta Mechanica Solida Sinica

Abstract:A strategy is proposed based on the stochastic averaging method for quasi non-integrable Hamiltonian systems and the stochastic dynamical programming principle. The proposed strategy can be used to design nonlinear stochastic optimal control to minimize the response of quasi non-integrable Hamiltonian systems subject to Gaussian white noise excitation. By using the stochastic averaging method for quasi non-integrable Hamiltonian systems the equations of motion of a controlled quasi non-integrable Hamiltonian system is reduced to a one-dimensional averaged Ito stochastic differential equation. By using the stochastic dynamical programming principle the dynamical programming equation for minimizing the response of the system is formulated. The optimal control law is derived from the dynamical programming equation and the bounded control constraints. The response of optimally controlled systems is predicted through solving the FPK equation associated with Ito stochastic differential equation. An example is worked out in detail to illustrate the application of the control strategy proposed.
Stochastic stability of quasi-integrable Hamiltonian systems with time delay by using Lyapunov function method

Quan Ling,XiaoLing Jin,ZhiLong Huang

DOI: https://doi.org/10.1007/s11431-010-0071-y

2010-01-01

Science China Technological Sciences

Abstract:The asymptotic Lyapunov stability of one quasi-integrable Hamiltonian system with time-delayed feedback control is studied by using Lyapunov functions and stochastic averaging method. First, a quasi-integrable Hamiltonian system with time-delayed feedback control subjected to Gaussian white noise excitation is approximated by a quasi-integrable Hamiltonian system without time delay. Then, stochastic averaging method for quasi-integrable Hamiltonian system is used to reduce the dimension of the original system, and after that the Lyapunov function of the averaged Itô equation is taken as the optimal linear combination of the corresponding independent first integrals in involution. Finally, the stability of the system is determined by using the largest eigenvalue of the linearized system. Two examples are used to illustrate the proposed procedure and the effects of delayed time on the Lyapunov stability are discussed as well.
Stochastic Optimal Bounded Control of Mdof Quasi Nonintegrable-Hamiltonian Systems with Actuator Saturation

Ronghua Huan,Yongjun Wu,Weiqiu Zhu

DOI: https://doi.org/10.1007/s00419-008-0218-5

2008-01-01

Archive of Applied Mechanics

Abstract:A new bounded optimal control strategy for multi-degree-of-freedom (MDOF) quasi nonintegrable-Hamiltonian systems with actuator saturation is proposed. First, an n-degree-of-freedom (n-DOF) controlled quasi nonintegrable-Hamiltonian system is reduced to a partially averaged Itô stochastic differential equation by using the stochastic averaging method for quasi nonintegrable-Hamiltonian systems. Then, a dynamical programming equation is established by using the stochastic dynamical programming principle, from which the optimal control law consisting of optimal unbounded control and bang–bang control is derived. Finally, the response of the optimally controlled system is predicted by solving the Fokker–Planck–Kolmogorov (FPK) equation associated with the fully averaged Itô equation. An example of two controlled nonlinearly coupled Duffing oscillators is worked out in detail. Numerical results show that the proposed control strategy has high control effectiveness and efficiency and that chattering is reduced significantly compared with the bang–bang control strategy.
Dynamics of Quasi Linear Systems with Multi-time-delayed Feedback Control and Wide-band Random Excitation.

Xueping Li,Weiqiu Zhu

DOI: https://doi.org/10.1109/FSKD.2009.350

2009-01-01

Abstract:The Stochastic response, stability and reliability of quasi-linear systems subject to multi-time-delayed feedback control and wide-band random excitation are studied by using the stochastic averaging method for quasi Hamiltonian systems. It is verified that the time delay affect the response, the asymptotic stability and the first-passage time greatly, but the deterioration can be almost eliminated if the delay time can be set correctly. All the results are confirmed by Monte Carlo simulation.
Stochastic stabilization of quasi non-integrable Hamiltonian systems

w q zhu,z l huang

DOI: https://doi.org/10.1016/S0020-7462(03)00072-6

IF: 3.336

2004-01-01

International Journal of Non-Linear Mechanics

Abstract:A procedure for designing a feedback control to asymptotically stabilize in probability a quasi non-integrable Hamiltonion system is proposed. First, an one-dimensional averaged Itô stochastic differential equation for controlled Hamiltonian is derived from given equations of motion of the system by using the stochastic averaging method for quasi non-integrable Hamiltonian systems. Second, a dynamical programming equation for an ergodic control problem with undetermined cost function is established based on the stochastic dynamical programming principle and solved to yield the optimal control law. Third, the asymptotic stability in probability of the system is analysed by examining the sample behaviors of the completely averaged Itô differential equation at its two boundaries. Finally, the cost function and the optimal control forces are determined by the requirement of stabilizing the system. Two examples are given to illustrate the application of the proposed procedure and the effect of control on the stability of the system.
Stochastic Hopf Bifurcation of Quasi-Integrable Hamiltonian Systems with Multi-Time-Delayed Feedback Control and Wide-Band Noise Excitations

Z. H. Liu,W. Q. Zhu

DOI: https://doi.org/10.1007/s11071-011-0315-9

IF: 5.741

2012-01-01

Nonlinear Dynamics

Abstract:The stochastic Hopf bifurcation of multi-degree-of-freedom (MDOF) quasi-integrable Hamiltonian systems with time-delayed feedback control subject to Gaussian white noise excitations is studied. First, the time-delayed feedback control forces are approximately expressed in terms of the system state variables without time delay, and the system is converted into anordinary quasi-integrable Hamiltonian system. The averaged Ito stochastic differential equations are derived by using the stochastic averaging method for quasi-integrable Hamiltonian systems. Then, an expression for the average bifurcation parameter of the averaged system is obtained approximately, and a criterion for determining the stochastic Hopf bifurcation caused by the time-delayed feedback control forces in the original system as the value of the average bifurcation parameter changing is proposed. An example is worked out in detail to illustrate the above criterion and its validity, and to show the e ffect of the time delay in the feedback control on the stochastic Hopf bifurcation of the system.
An Asymptotic Method for Quasi-Integrable Hamiltonian System with Multi-Time-delayed Feedback Controls under Combined Gaussian and Poisson White Noises

Wantao Jia,Yong Xu,Zhonghua Liu,Weiqiu Zhu

DOI: https://doi.org/10.1007/s11071-017-3832-3

IF: 5.741

2017-01-01

Nonlinear Dynamics

Abstract:In the present paper, we consider an approximate approach for predicting the responses of the quasi-integrable Hamiltonian system with multi-time-delayed feedback control under combined Gaussian and Poisson white noise excitations. Two-step approximation is taken here to obtain the responses of such system. First, based on the property of the system solution, the time-delayed system state variables are approximated by using the system state variables without time delay. After this approximation, the system is converted to the one without time delay but with delay time as parameters. Then, stochastic averaging method for quasi-integrable Hamiltonian system under combined Gaussian and Poisson white noises is applied to simplify the converted system to obtain the averaged stochastic integro-differential equations and generalized Fokker–Planck–Kolmogorov equations for both non-resonant and resonant cases. Finally, two examples are worked out to show the detailed procedure of proposed method for the illustrative purpose. And the influences of the time delay on the responses of the systems are also discussed. In addition, the validity of the results obtained by present method is verified by Monte Carlo simulation.
Stochastic Averaging of Quasi-Integrable Hamiltonian Systems with Delayed Feedback Control

Z. H. Liu,W. Q. Zhu

DOI: https://doi.org/10.1016/j.jsv.2006.07.007

IF: 4.7

2006-01-01

Journal of Sound and Vibration

Abstract:A stochastic averaging method for quasi-integrable Hamiltonian systems with time-delayed feedback control is proposed. First, a quasi-integrable Hamiltonian system with delayed feedback control subjected to Gaussian white noise excitations is formulated and then transformed into Itô stochastic differential equations without time delay. Then, the averaged Itô stochastic differential equations for the system are derived and the stationary solution of the averaged Fokker–Planck–Kolmogorov (FPK) equation associated with the averaged Itô equations is obtained for both non-resonant and resonant cases. Finally, three examples are worked out in detail to illustrate the application and effectiveness of the proposed method and the effect of time delayed feedback control on the response of the systems.

Stochastic Optimal Time-Delay Control of Quasi-Integrable Hamiltonian Systems

Stochastic Minimax Optimal Time-Delay State Feedback Control of Uncertain Quasi-Integrable Hamiltonian Systems

Optimal Guaranteed Cost Control for a Class of Linear Uncertain Time-Delay Systems

Stochastic Fractional Optimal Control of Quasi-Integrable Hamiltonian System with Fractional Derivative Damping

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

Robust Stabilizing Control for Uncertain Time-Delay Systems with Output Feedback

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

Optimal bounded control of quasi non-integrable Hamiltonian systems

A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Compensation for Time-Delayed Feedback Bang-Bang Control of Quasi-Integrable Hamiltonian Systems

Optimal Bounded Control of First-Passage Failure of Quasi-Integrable Hamiltonian Systems with Wide-Band Random Excitation

Optimal Control Strategies for Stochastically Excited Quasi Partially Integrable Hamiltonian Systems

Stochastic Optimal Control of Quasi Integrable Hamiltonian Systems Subject to Actuator Saturation

Stochastic Optimal Control for the Response of Quasi Non-Integrable Hamiltonian Systems

Stochastic stability of quasi-integrable Hamiltonian systems with time delay by using Lyapunov function method

Stochastic Optimal Bounded Control of Mdof Quasi Nonintegrable-Hamiltonian Systems with Actuator Saturation

Dynamics of Quasi Linear Systems with Multi-time-delayed Feedback Control and Wide-band Random Excitation.

Stochastic stabilization of quasi non-integrable Hamiltonian systems

Stochastic Hopf Bifurcation of Quasi-Integrable Hamiltonian Systems with Multi-Time-Delayed Feedback Control and Wide-Band Noise Excitations

An Asymptotic Method for Quasi-Integrable Hamiltonian System with Multi-Time-delayed Feedback Controls under Combined Gaussian and Poisson White Noises

Stochastic Averaging of Quasi-Integrable Hamiltonian Systems with Delayed Feedback Control