Abstract:Stochastic optimal control based on reliability plays a crucial role in mitigating structural failure and ensuring safe operation. For general stochastic vibration systems, a data-driven method for reliability-based optimal control is proposed based on random state data. Firstly, the feedback control is split into conservative and dissipative components in coherence with physical intuition, and each component is expanded upon using pre-selected basic functions, resulting in a modified system with undetermined coefficients. Then, from discrete random samples, the expressions for the probability densities of the first-passage time and the stationary response can be identified, explicitly including system and excitation parameters, as well as initial and safety boundary conditions. Finally, a performance index, combining system reliability and control cost, is constructed and can be explicitly expressed in terms of the undetermined coefficients of the control forces. The optimal control problem for determining the optimal control forces is reformulated as an optimization problem for determining the coefficients that minimize the performance index. This unconstrained optimization problem can be easily solved. Three typical nonlinear stochastic systems, a controlled Duffing oscillator, a controlled nonlinear hysteretic system, and a controlled 2-DOF nonlinear dynamical system, are given to illustrate the validity and accuracy of the proposed data-driven method. Additionally, the control performance of the optimal control strategy in improving the system reliability is also discussed.

Data-based stable value iteration optimal control for unknown discrete-time systems with time delays.

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

New Design Approach of Delay-Dependent Robust Stabilizing Control for Uncertain Time-Delay Systems

H ∞ optimal control of unknown linear systems by adaptive dynamic programming with applications to time‐delay systems

Infinite-time stochastic linear quadratic optimal control for unknown discrete-time systems using adaptive dynamic programming approach

Learning-based adaptive optimal control of linear time-delay systems: A value iteration approach

Probability-Weighted Optimal Control for Nonlinear Stochastic Vibrating Systems with Random Time Delay

A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Reliability Control of Nonlinear Stochastic Dynamical System Based on Discrete Data

Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems

Optimal control for discrete-time affine non-linear systems using general value iteration

ADP-Based Optimal Control of Linear Singularly Perturbed Systems With Uncertain Dynamics: A Two-Stage Value Iteration Method

Optimal Control for Linear Time-Varying Systems with Multiple Time-Delays

Model-free optimal control design for a class of linear discrete-time systems with multiple delays using adaptive dynamic programming.

Data-driven Adaptive Optimal Control for Discrete-Time Linear Time-Invariant Systems

Finite Convergence of Value Iteration Algorithm for Discounted Infinite Horizon Optimal Control of Stochastic Logical Systems

An optimal control method for linear systems with time delay

Adaptive Dynamic Programming and Optimal Stabilization for Linear Systems with Time-Varying Uncertainty

Stochastic Control for Discrete-Time Systems with Input Delay.

Nearly Finite-Horizon Optimal Control for A Class of Nonaffine Time-Delay Nonlinear Systems Based on Adaptive Dynamic Programming

New Stabilization Method for Linear Systems with Time-Varying Input Delay