Abstract:An optimal control problem is considered for a stochastic differential equation with the cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). This kind of cost functional can cover the general discounting (including exponential and non-exponential) situation with a recursive feature. It is known that such a problem is time-inconsistent in general. Therefore, instead of finding a global optimal control, we look for a time-consistent locally near optimal equilibrium strategy. With the idea of multi-person differential games, a family of approximate equilibrium strategies is constructed associated with partitions of the time intervals. By sending the mesh size of the time interval partition to zero, an equilibrium Hamilton--Jacobi--Bellman (HJB, for short) equation is derived, through which the equilibrium valued function and an equilibrium strategy are obtained. Under certain conditions, a verification theorem is proved and the well-posedness of the equilibrium HJB is established. As a sort of Feynman-Kac formula for the equilibrium HJB equation, a new class of BSVIEs (containing the diagonal value $Z(r,r)$ of $Z(\cd,\cd)$) is naturally introduced and the well-posedness of such kind of equations is briefly presented.

An Iteration Algorithm of Approximate Solutions to Optimal Control Problems for Retarded Volterra Integral Systems

Iterative design of suboptimal feedback control for bilinear parabolic PDE systems

Near-Optimal Controls of Volterra Integral System with Distributed and Discretely Nonlinear Time Delays

Necessary Conditions for Minimax Control of Retarded Volterra Type Integral System with State Terminal Constraints

H ∞ optimal control of unknown linear systems by adaptive dynamic programming with applications to time‐delay systems

Controllability of a class of infinite dimensional linear systems

Robust Adaptive Iterative Learning Control for Discrete-Time Nonlinear Systems With Time-Iteration-Varying Parameters.

A High-Order Internal Model Based Iterative Learning Control Scheme for Discrete Linear Time-Varying Systems

Optimal control of impulsive Volterra equations with variable impulse times

Finite Element Approximations of Impulsive Optimal Control Problems for Heat Equations

Optimal control for discrete-time affine non-linear systems using general value iteration

Optimal Control with Partial Information for Stochastic Volterra Equations

Learning-based adaptive optimal control of linear time-delay systems: A value iteration approach

Approximating the Linear Quadratic Optimal Control Law for Hereditary Systems with Delays in the Control

Model-free Value Iteration Algorithm for Continuous-time Stochastic Linear Quadratic Optimal Control Problems

An Efficient Algorithm for Solving Nonlinear Volterra-Fredholm Integral Equations

Passivity-based Finite-time Bounded Stabilization of Nonlinear Singularly Perturbed Systems with Time Delays: an Iterative Solving Algorithm

An iterative method to solve the time delay optimal control problem with bounded control variable

VISCOCITY SOLUTIONS AND APPROXIMATE ALGORITHM ANALYSIS OF NONLINEAR H∞ CONTROL

Time-Inconsistent Stochastic Optimal Control Problems and Backward Stochastic Volterra Integral Equations

Solvability and Optimal Controls of a Fractional Impulsive Stochastic Partial Integro-Differential Equation with State-Dependent Delay