What problem does this paper attempt to address?

Based on the provided text content, the main problems that this paper attempts to solve are as follows: 1. **Expand the application scope of dynamic programming techniques**: The paper aims to apply dynamic programming techniques to the study of discrete - time infinite - horizon optimal control problems, especially those with state - independent optimal asymptotic average cost on compact control - invariant sets. By analyzing the interaction between dissipativity and optimal control, new recursive methods are proposed to solve the so - called "shifted Bellman equation". 2. **Introduce terminal penalty**: Introduce terminal penalty in infinite - horizon optimal control, in the form of a suitable storage function with a negative sign. This helps to deal with the long - term average performance problem in infinite - horizon optimal control problems. 3. **Propose the shifted Bellman equation**: For the non - zero (but state - independent) optimal long - term average performance problem, a shifted Bellman equation is proposed. This method is applicable to systems with periodic, almost periodic or even chaotic operation modes, allowing for general time - varying asymptotic costs along the optimal solution. 4. **Propose new recursive methods**: Two new recursive methods are proposed, whose fixed points are the solutions of the shifted Bellman equation. These methods have good convergence properties under fairly general assumptions and can calculate the optimal average performance and the corresponding value function simultaneously. 5. **Handle the trade - off between transient cost and asymptotic average performance**: Study how to minimize the transient cost without affecting the asymptotic average performance, which is an unsolved problem in existing methods. In general, by introducing new mathematical tools and methods, the paper aims to expand the application scope of dynamic programming in infinite - horizon optimal control problems, especially dealing with complex systems that are difficult to solve by traditional methods.

Dissipativity in Infinite Horizon Optimal Control and Dynamic Programming

Dissipativity and optimal control

Infinite Horizon Sparse Optimal Control

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Optimal control on finite graphs: asymptotic optimal controls and ergodic constant in the case of entropic costs

Analysis of the vanishing discount limit for optimal control problems in continuous and discrete time

Infinite horizon optimal control of forward-backward stochastic differential equations with delay

Infinite time horizon stochastic recursive control problems with jumps: dynamic programming and stochastic verification theorems

Dynamic Programming in Probability Spaces via Optimal Transport

Using dynamic programming with adaptive grid scheme for optimal control problems in economics

Impulse Control of Multi-dimensional Jump Diffusions in Finite Time Horizon

An Optimal Solution to Infinite Horizon Nonlinear Control Problems: Part II

Finite Horizon Stochastic Optimal Switching and Impulse Controls with a Viscosity Solution Approach

Dissipativity in Economic Model Predictive Control: Beyond Steady-State Optimality

Optimal bounds for POD approximations of infinite horizon control problems based on time derivatives

IsoCost-Based Dynamic Programming for Solving Infinite Horizon Optimal Control Problems

Variational Dynamic Programming for Stochastic Optimal Control

Improved Dynamic Programming Methods for Optimal Control of Lumped-Parameter Stochastic Systems

Infinite Horizon Average Cost Optimality Criteria for Mean-Field Control

Adaptive dynamic programming and distributionally robust optimal control of linear stochastic system using the Wasserstein metric