Abstract:Stochastic optimal control based on reliability plays a crucial role in mitigating structural failure and ensuring safe operation. For general stochastic vibration systems, a data-driven method for reliability-based optimal control is proposed based on random state data. Firstly, the feedback control is split into conservative and dissipative components in coherence with physical intuition, and each component is expanded upon using pre-selected basic functions, resulting in a modified system with undetermined coefficients. Then, from discrete random samples, the expressions for the probability densities of the first-passage time and the stationary response can be identified, explicitly including system and excitation parameters, as well as initial and safety boundary conditions. Finally, a performance index, combining system reliability and control cost, is constructed and can be explicitly expressed in terms of the undetermined coefficients of the control forces. The optimal control problem for determining the optimal control forces is reformulated as an optimization problem for determining the coefficients that minimize the performance index. This unconstrained optimization problem can be easily solved. Three typical nonlinear stochastic systems, a controlled Duffing oscillator, a controlled nonlinear hysteretic system, and a controlled 2-DOF nonlinear dynamical system, are given to illustrate the validity and accuracy of the proposed data-driven method. Additionally, the control performance of the optimal control strategy in improving the system reliability is also discussed.

Data-Based Efficient Off-Policy Stabilizing Optimal Control Algorithms for Discrete-Time Linear Systems via Damping Coefficients

A Bounded Optimal Control for Maximizing the Reliability of Randomly Excited Nonlinear Oscillators with Fractional Derivative Damping

Learning Optimal Control Policy for Unknown Discrete-Time Systems

Data-Driven H∞ Optimal Output Feedback Control for Linear Discrete-Time Systems Based on Off-Policy Q-Learning

Reliability Control of Nonlinear Stochastic Dynamical System Based on Discrete Data

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

An Off‐policy Iteration Algorithm for Robust Stabilization of Constrained‐input Uncertain Nonlinear Systems

Data-Driven Suboptimal Control for Nonlinear Systems Using State-Dependent Riccati Equation.

Reinforcement Learning for Adaptive Optimal Stationary Control of Linear Stochastic Systems

Data-driven Adaptive Optimal Control for Discrete-Time Linear Time-Invariant Systems

Reinforcement Learning with Adjustable Convergence Rate for Data-Based Nonlinear Control

Online Policy Iteration Algorithm for Optimal Control of Linear Hyperbolic PDE Systems

Homotopic policy iteration-based learning design for unknown linear continuous-time systems

Data-driven cooperative optimal output regulation for linear discrete-time multi-agent systems by online distributed adaptive internal model approach

Data-Driven Robust Control of Discrete-Time Uncertain Linear Systems Via Off-Policy Reinforcement Learning.

Policy Optimization Adaptive Dynamic Programming for Optimal Control of Input-Affine Discrete-Time Nonlinear Systems.

Optimal dynamic output feedback control of unknown linear continuous-time systems by adaptive dynamic programming

An efficient data-based off-policy Q-learning algorithm for optimal output feedback control of linear systems

Stochastic Reinforcement Learning with Stability Guarantees for Control of Unknown Nonlinear Systems

Data-based Optimal Control for Discrete-time Systems Via Deep Deterministic Policy Gradient Adaptive Dynamic Programming

Adaptive Optimal Control of Discrete-Time Linear Systems with Discounted Value: Off-Policy Reinforcement Learning