Optimum Control and Relaxation for Nonlinear Delay Evolution Systems

KUANG Hua-wu,XIANG Xiao-ling

2000-01-01

Abstract:In this paper,optimal control and relaxation for nonlinear del ay evolution systems are studied.Under reasonable conditions,the existence of th e original trajectory and the optimal cotrol is proved.Further,the relaxation is introduced to consider the nature of the relaxed traje ctory.

What problem does this paper attempt to address?

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

Ying Yang,Yong Wang,Zhilong Huang,Xiangying Ji

DOI: https://doi.org/10.1016/j.probengmech.2020.103078

IF: 2.954

2020-01-01

Probabilistic Engineering Mechanics

Abstract:Optimal control for improving the stability and reliability of nonlinear stochastic dynamical systems is of great significance for enhancing system performances. However, it has not been adequately investigated because the evaluation indicators for stability (e.g. maximal Lyapunov exponent) and for reliability (e.g. mean first-passage time) cannot be explicitly expressed as the functions of system states. Here, a unified procedure is established to derive optimal control strategies for improving system stability and reliability, in which a physical intuition-inspired separation technique is adopted to split feedback control forces into conservative components and dissipative components, the stochastic averaging is then utilized to express the evaluation indicators of performances of controlled system, the optimal control strategies are finally derived by minimizing the performance indexes constituted by the sigmoid function of maximal Lyapunov exponent (for stability-based control)/the reciprocal of mean first-passage time (for reliability-based control), and the mean value of quadratic form of control force. The unified procedure converts the original functional extreme problem of optimal control into an extremum value problem of multivariable function which can be solved by optimization algorithms. A numerical example is worked out to illustrate the efficacy of the optimal control strategies for enhancing system performance.
Nonlinear Stochastic Optimal Control of Viscoelastic Systems

Hao Xiong,Weiqiu Zhu

DOI: https://doi.org/10.1177/1077546313489589

IF: 2.633

2013-01-01

Journal of Vibration and Control

Abstract:A nonlinear stochastic optimal control strategy for single degree-of-freedom viscoelastic systems with strongly nonlinear stiffness under Gaussian white noise excitation is proposed. First, the viscoelastic system is converted into an equivalent nonlinear non-viscoelastic system by replacing the viscoelastic force with amplitude-dependent stiffness and damping. Second, the partially averaged Itô stochastic differential equation for total system energy as one-dimensional controlled diffusion process is derived by using the stochastic averaging method of energy envelope. For the semi-infinite time-interval ergodic control, the dynamical programming equation is established based on the dynamical programming principle and is solved to yield the optimal control force. Finally, the variances of the responses of controlled and uncontrolled systems and that of the optimal control force are predicted analytically. Numerical results show that the proposed control strategy is very effective and efficient.
Optimal bounded control of quasi non-integrable Hamiltonian systems

WQ Zhu,ML Deng

2003-01-01

Abstract:The optimal bounded control of quasi non-integrable Hamiltonian systems (multi-degree-of-freedom non-integrable Hamiltonian systems subject to light dampings and weakly random excitations) for minimizing their response is investigated. The equations of motion of a controlled quasi non-integrable Hamiltonian system is first reduced to an averaged Ito stochastic differential equation for the Hamiltonian by using the stochastic averaging method for quasi non-integrable Hamiltonian systems. Then, a dynamical programming equation for the control problem of minimizing response is formulated. The optimal control law is derived from the dynamical programming equation and the control constraints. Finally, the response of optimally controlled system is predicted from solving the Fokker-Planck-Kolmogrov (FPK) equation associated with completely averaged lto equation. An example is worked out to illustrate the application and effectiveness of the proposed control strategy.
Practical Stability and Exponential Estimates of Trajectory Bounds for Retarded Systems with Bounded Disturbances

Chunhai Hou,Jixin Qian

DOI: https://doi.org/10.1006/jmaa.1998.5953

IF: 1.417

1998-01-01

Journal of Mathematical Analysis and Applications

Abstract:The properties of practical stability and exponential estimates of trajectory bounds for retarded systems with uncertain external disturbances are investigated. Our approach is adaptable to general regarded functional differential equations (RFDEs) with bounded disturbances. By applying our results to the LQ regulator problem with uncertain input delay and bounded external disturbances, it can be found that our results provide an effective method for quantitative stability analysis of retarded systems.
A Bounded Optimal Control for Maximizing the Reliability of Randomly Excited Nonlinear Oscillators with Fractional Derivative Damping

Lincong Chen,Qun Lou,Qingqu Zhuang,Weiqiu Zhu

DOI: https://doi.org/10.1007/s00707-012-0722-0

IF: 2.645

2012-01-01

Acta Mechanica

Abstract:In this paper, a bounded optimal control for maximizing the reliability of randomly excited nonlinear oscillators with fractional derivative damping is proposed. First, the partially averaged Itô equations for the energy processes of individual degree of freedom are derived by using the stochastic averaging method. Second, the dynamical programming equations for the control problems of maximizing the reliability function and maximizing the mean first passage time are established from the partially averaged Itô equations by using the dynamical programming principle. The optimal control law is derived from the dynamical programming equation and control constraints. Third, the conditional reliability function and mean first passage time of the optimally controlled system are obtained by solving the backward Kolmogorov equation and Pontryagin equation associated with the fully averaged Itô equation, respectively. The application of the proposed procedure and effectiveness of the control strategy are illustrated by using two examples. Besides, the effect of fractional derivative order on the reliability of the optimally controlled system is examined.
Stochastic Optimal Time-Delay Control of Quasi-Integrable Hamiltonian Systems

Ju Feng,Weiqiu Zhu,Бо Лю

DOI: https://doi.org/10.1016/j.cnsns.2010.11.020

IF: 4.186

2011-01-01

Communications in Nonlinear Science and Numerical Simulation

Abstract:National Science Foundation of China [10932009, 11072212]; Zhejiang Provincial Natural Science Foundation [Y7080070]
A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Z. G. Ying,W. Q. Zhu

DOI: https://doi.org/10.12989/sem.2009.31.5.621

2009-01-01

Abstract:The time delay in active and semi-active controls is an important research subject. Many researches on the time-delay control for deterministic systems have been made (Hu and Wang 2002, Yang el al. 1990, Abdel-Mooty and Roorda 1991, Pu 1998, Cai and Huang 2002), while the study on that for stochastic systems is very limited. The effects of the time delay on the control of nonlinear systems under Gaussian white noise excitations have been studied by Bilello et al. (2002). The controlled linear systems with deterministic and random time delay subjected to Gaussian white noise excitations have been treated by Grigoriu (1997). Recently, a stochastic averaging method for quasi-integrable Hamiltonian systems with time delay has been proposed (Liu and Zhu 2007). In the present paper, a stochastic optimal time-delay control method for stochastically excited nonlinear structural systems is proposed based on the stochastic, averaging method for quasi Hamiltonian systems with time delay and the stochastic dynamical,, programming principle. An example of stochastically excited and controlled hysteretic column is given to illustrate the proposed control method.
Second Order Optimality Conditions for Optimal Control Problems of Stochastic Evolution Equations

Qi Lu,Haisen Zhang,Xu Zhang

DOI: https://doi.org/10.48550/arXiv.1811.07337

2018-11-18

Abstract:In this paper, we establish some second order necessary/sufficient optimality conditions for optimal control problems of stochastic evolution equations in infinite dimensions. The control acts on both the drift and diffusion terms and the control region is convex. The concepts of relaxed and $V$-transposition solutions (introduced in our previous works) to operator-valued backward stochastic evolution equations are employed to derive these optimality conditions. The correction part of the second order adjoint equation, which does not appear in the (first order) Pontryagin-type stochastic maximum principle, plays a fundamental role in our second order optimality conditions.

Optimization and Control
Existence and optimal controls of non-autonomous for impulsive evolution equation without Lipschitz assumption

Lixin Sheng,Weimin Hu,You-Hui Su

DOI: https://doi.org/10.1186/s13661-024-01819-5

2024-01-20

Boundary Value Problems

Abstract:In this paper, we investigate the existence of mild solutions as well as optimal controls for non-autonomous impulsive evolution equations with nonlocal conditions. Using the Schauder's fixed-point theorem as well as the theory of evolution family, we prove the existence of mild solutions for the concerned problem. Furthermore, without the Lipschitz continuity of the nonlinear term, the optimal control result is derived by setting up minimizing sequences twice. An example is given of the application of the results.

mathematics, applied
Relaxation and asymptotic expansion of controlled stiff differential equations

Michael Herty,Hicham Kouhkouh

2024-04-22

Abstract:The control of relaxation-type systems of ordinary differential equations is investigated using the Hamilton-Jacobi-Bellman equation. First, we recast the model as a singularly perturbed dynamics which we embed in a family of controlled systems. Then we study this dynamics together with the value function of the associated optimal control problem. We provide an asymptotic expansion in the relaxation parameter of the value function. We also show that its solution converges toward the solution of a Hamilton-Jacobi-Bellman equation for a reduced control problem. Such systems are motivated by semi-discretisation of kinetic and hyperbolic partial differential equations. Several examples are presented including Jin-Xin relaxation.

Optimization and Control
ADVANCES IN RESEARCH ON NONLINEAR STOCHASTIC OPTIMAL CONTROL OF QUASI-HAMILTONIAN SYSTEMS

朱位秋,应祖光

DOI: https://doi.org/10.6052/1000-0992-12-045

2013-01-01

Abstract:Advances in the theory of nonlinear stochastic optimal control of quasi-Hamiltonian systems and its applications in the last decade is summarized. It includes: (1) the basic nonlinear stochastic optimal control strategies based on the stochastic averaging method for quasi-Hamiltonian systems and the stochastic dynamical programming principle, that is, response minimization control, stochastic stabilization, first-passage failure minimization control, and the control for targeting a specified stationary probability density function; (2) further study on the nonlinear stochastic optimal control for application, such as optimal control of partially observable systems, bounded optimal control, time-delay optimal control, semi-active optimal control and minimax control; (3) the integrated nonlinear stochastic optimal control strategy; (4) the applications of the nonlinear stochastic optimal control strategy to engineering structures including hysteretic systems and fractional derivative systems. Some related background and problems to be studied in future are also pointed out.
An Optimal Nonlinear Feedback Control Strategy for Randomly Excited Structural Systems

W. Q. Zhu,Z. G. Ying,T. T. Soong

DOI: https://doi.org/10.1023/A:1026527404183

IF: 5.741

2001-01-01

Nonlinear Dynamics

Abstract:A strategy for optimal nonlinear feedback control of randomlyexcited structural systems is proposed based on the stochastic averagingmethod for quasi-Hamiltonian systems and the stochastic dynamicprogramming principle. A randomly excited structural system isformulated as a quasi-Hamiltonian system and the control forces aredivided into conservative and dissipative parts. The conservative partsare designed to change the integrability and resonance of the associatedHamiltonian system and the energy distribution among the controlledsystem. After the conservative parts are determined, the system responseis reduced to a controlled diffusion process by using the stochasticaveraging method. The dissipative parts of control forces are thenobtained from solving the stochastic dynamic programming equation. Boththe responses of uncontrolled and controlled structural systems can bepredicted analytically. Numerical results for a controlled andstochastically excited Duffing oscillator and a two-degree-of-freedomsystem with linear springs and linear and nonlinear dampings, show thatthe proposed control strategy is very effective and efficient.
Optimal Nonlinear Feedback Control of Quasi-Hamiltonian Systems

Weiqiu Zhu,Zuguang Ying

DOI: https://doi.org/10.1007/bf02875989

1999-01-01

Science in China Series A Mathematics

Abstract:An innovative strategy for optimal nonlinear feedback control of linear or nonlinear stochastic dynamic systems is proposed based on the stochastic averaging method for quasi-Hamiltonian systems and stochastic dynamic programming principle. Feedback control forces of a system are divided into conservative parts and dissipative parts. The conservative parts are so selected that the energy distribution in the controlled system is as requested as possible. Then the response of the system with known conservative control forces is reduced to a controlled diffusion process by using the stochastic averaging method. The dissipative parts of control forces are obtained from solving the stochastic dynamic programming equation.
Optimal Control of Unified Chaos System

Yun-zhong SONG,Guang-zhou ZHAO,Dong-lian QI

DOI: https://doi.org/10.3969/j.issn.1004-731X.2007.01.033

2007-01-01

Abstract:In order to realize the stabilizing control of the unified chaos system, optimal control was designed for the unified chaos system based on the minimum principle. The two equilibria of the unified chaos system, which are essentially unstable, can be stabilized by the optimal controller. In case of clarity and completeness, all the three different switching surfaces or curves which are depend on the imposed positions of the control signal are derived and the resulted control law is proved to be a bang-bang one. Logic decision part is employed to guarantee the right action of the control when it is added to the third equation so as to overcome the drawback of the single switching control. Simulation results of the transient process of the states and the projections of the phase locus of the closed control system are provided to demonstrate the effectiveness of the suggested scheme.
Probability-Weighted Optimal Control for Nonlinear Stochastic Vibrating Systems with Random Time Delay

R. C. Hu,Q. F. Lu,X. F. Wang,Z. G. Ying,R. H. Huan

DOI: https://doi.org/10.1155/2018/5636541

IF: 1.616

2018-01-01

Shock and Vibration

Abstract:A probability-weighted optimal control strategy for nonlinear stochastic vibrating systems with random time delay is proposed. First, by modeling the random delay as a finite state Markov process, the optimal control problem is converted into the one of Markov jump systems with finite mode. Then, upon limiting averaging principle, the optimal control force is approximately expressed as probability-weighted summation of the control force associated with different modes of the system. Then, by using the stochastic averaging method and the dynamical programming principle, the control force for each mode can be readily obtained. To illustrate the effectiveness of the proposed control, the stochastic optimal control of a two degree-of-freedom nonlinear stochastic system with random time delay is worked out as an example.
Time optimal control for a class of evolutionary equations with applications

Guangxuan Lin,School of Mathematics and Physics, Guangxi Minzu University, China,Biao Zeng,Guangxi Key Laboratory of Universities Optimization Control and Engineering Calculation, School of Mathematics and Physics, Guangxi Minzu University, China

DOI: https://doi.org/10.3934/eect.2024001

2024-01-09

Evolution Equations and Control Theory

Abstract:In the paper we deal with a time optimal control problem for a class of evolutionary equations involving two linear operators and a bilinear operator. Based on the existence and uniqueness of the solution, we establish the existence of optimal controls and several optimality conditions for the time optimal control problem. Finally, the main results are applied to a class of quasistatic frictional contact problems.

mathematics, applied
An optimal control for non-autonomous second-order stochastic differential equations with delayedarguments

Hasanen A Hammad,Doha A Kattan

DOI: https://doi.org/10.1088/1402-4896/ad8604

2024-10-13

Physica Scripta

Abstract:Optimal control of non-autonomous second-order stochastic differential equations with delayed arguments is indispensable for managing systems exposed to uncertainty, time-dependent dynamics, and historical influences. These equations underpin a wide range of applications, including finance, engineering, and biology, where it's imperative to make informed decisions that mitigate risks or maximize returns while considering the inherent randomness, evolving conditions, and the impact of past states. By employing optimal control techniques, we can devise strategies that are resilient to uncertainty, adaptable to changing circumstances, and capable of accounting for the memory effects of previous events. This empowers us to optimize system performance, bolster stability, and attain desired objectives in intricate and dynamic environments. So, the goal of this article is to introduce a novel model of second-order perturbed stochastic differential equations incorporating non-local finite delay and deviated arguments in the setting of Hilbert spaces. Moreover, essential criteria are presented to examine the existence of a mild solution and evaluate the potential for approximate and optimal control of the proposed system. These results have been obtained by using evolution operators, fixed point techniques, random analytic methods, and compact semigroup theory. Further, to support the theoretical results, the optimal controllability of our model was studied by considering the Lagrange problem. Finally, the results were applied to discuss the approximate controllability of a partial differential equation. These models have the potential to advance the understanding and application of optimal control techniques for a wider range of complex systems.

physics, multidisciplinary
Existence and relaxation for optimal control governed by steady, quasilinear PDEs

Pablo Pedregal

2024-01-19

Abstract:We focus on optimal control problems governed by elliptic, quasilinear PDEs. Though there are various examples of such problems in the literature, we make an attempt at describing some general principles by dealing with three basic situations. In the first one, we assume that the state equation is variational; the second one focuses on a non-variational, monotone operator as state equation; finally, we add a non-linear term off the divergence part of the equation. In the first two cases, existence of optimal solutions can be established under suitable sets of assumptions, while relaxation is required for the third situation. Concerning the cost functional, and though more general examples can be dealt with, we will take a typical case consisting of two terms: one depending on the state, and another one of the form of a typical Thychonov regularization.

Optimization and Control
Optimal Control of Nonsmooth System Governed by Quasi-Linear Elliptic Equations

Gong Liutang,Fei Pusheng

DOI: https://doi.org/10.1155/s0161171297000458

1997-01-01

International Journal of Mathematics and Mathematical Sciences

Abstract:In this paper, we discuss a class of optimal control problems of nonsmooth systems governed by quasi-linear elliptic partial differential equations, give the existence of the problem. Through the smoothness and the approximation of the original problem, we get the necessary condition, which can be considered as the Euler-Lagrange condition under quasi-linear case.
Optimal state-delay control in nonlinear dynamic systems

Chongyang Liu,Ryan Loxton,Kok Lay Teo,Song Wang

DOI: https://doi.org/10.1016/j.automatica.2021.109981

IF: 6.4

2022-01-01

Automatica

Abstract:This paper considers a class of nonlinear systems in which the control function is a time-varying state-delay. The optimal control problem is to optimize the time-varying delay and a set of time-invariant system parameters subject to lower and upper bounds. To solve this problem, we first parameterize the delay in terms of piecewise-quadratic basis functions, thus yielding a finite-dimensional approximate problem with continuous-time inequality constraints induced by the delay bounds. We then exploit the quadratic structure of the delay to convert these continuous-time constraints into a finite set of canonical point constraints. We also develop an efficient numerical method for computing the gradients of the system cost function. This method, which involves integrating an auxiliary impulsive system with time-varying advance backwards in time, can be combined with any existing gradient-based optimization algorithm to generate approximate solutions for the optimal control problem.

automation & control systems,engineering, electrical & electronic

Optimum Control and Relaxation for Nonlinear Delay Evolution Systems

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

Nonlinear Stochastic Optimal Control of Viscoelastic Systems

Optimal bounded control of quasi non-integrable Hamiltonian systems

Practical Stability and Exponential Estimates of Trajectory Bounds for Retarded Systems with Bounded Disturbances

A Bounded Optimal Control for Maximizing the Reliability of Randomly Excited Nonlinear Oscillators with Fractional Derivative Damping

Stochastic Optimal Time-Delay Control of Quasi-Integrable Hamiltonian Systems

A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Second Order Optimality Conditions for Optimal Control Problems of Stochastic Evolution Equations

Existence and optimal controls of non-autonomous for impulsive evolution equation without Lipschitz assumption

Relaxation and asymptotic expansion of controlled stiff differential equations

ADVANCES IN RESEARCH ON NONLINEAR STOCHASTIC OPTIMAL CONTROL OF QUASI-HAMILTONIAN SYSTEMS

An Optimal Nonlinear Feedback Control Strategy for Randomly Excited Structural Systems

Optimal Nonlinear Feedback Control of Quasi-Hamiltonian Systems

Optimal Control of Unified Chaos System

Probability-Weighted Optimal Control for Nonlinear Stochastic Vibrating Systems with Random Time Delay

Time optimal control for a class of evolutionary equations with applications

An optimal control for non-autonomous second-order stochastic differential equations with delayedarguments

Existence and relaxation for optimal control governed by steady, quasilinear PDEs

Optimal Control of Nonsmooth System Governed by Quasi-Linear Elliptic Equations

Optimal state-delay control in nonlinear dynamic systems