Abstract:A classical problem in ergodic continuous time control consists of studying the limit behavior of the optimal value of a discounted cost functional with infinite horizon as the discount factor $\lambda$ tends to zero. In the literature, this problem has been addressed under various controllability or ergodicity conditions ensuring that the rescaled value function converges uniformly to a constant limit. In this case the limit can be characterized as the unique constant such that a suitable Hamilton-Jacobi equation has at least one continuous viscosity solution. In this paper, we study this problem without such conditions, so that the aforementioned limit needs not be constant. Our main result characterizes the uniform limit (when it exists) as the maximal subsolution of a system of Hamilton-Jacobi equations. Moreover, when such a subsolution is a viscosity solution, we obtain the convergence of optimal values as well as a rate of convergence. This mirrors the analysis of the discrete time case, where we characterize the uniform limit as the supremum over a set of sub-invariant half-lines of the dynamic programming operator. The emerging structure in both discrete and continuous time models shows that the supremum over sub-invariato half-lines with respect to the Lax-Oleinik semigroup/dynamic programming operator, captures the behavior of the limit cost as discount vanishes.

Asymptotics of a Solution to an Optimal Control Problem with a Terminal Convex Performance Index and a Perturbation of the Initial Data

Asymptotics of the Solution of a Bisingular Optimal Distributed Control Problem in a Convex Domain with a Small Parameter Multiplying a Highest Derivative

Iterative design of suboptimal feedback control for bilinear parabolic PDE systems

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

Brief paper: Stochastic minimax control for stabilizing uncertain quasi- integrable Hamiltonian systems

Analysis and approximation to parabolic optimal control problems with measure-valued controls in time

An Optimal Solution to Infinite Horizon Nonlinear Control Problems: Part II

Optimal control problems with oscillations, concentrations and discontinuities

Optimal Control for a Class of Infinite Dimensional Systems Involving an $L^\infty$-term in the Cost Functional

Convergence and quasi-optimality of an adaptive finite element method for optimal control problems with integral control constraint

Necessary Conditions In Infinite-Horizon Control Problem That Need No Asymptotic Assumptions

An Asymptotic Weak Maximum Principle

Analysis of the vanishing discount limit for optimal control problems in continuous and discrete time

Hybrid Optimal Control Problems for a Class of Semilinear Parabolic Equations

On optimal control problems with generalized invariant convex interval-valued functionals

Convexity and monotonicity in nonlinear optimal control under uncertainty

Optimal control problem for Stokes system: Asymptotic analysis via unfolding method in a perforated domain

Convexity in Optimal Control Problems

Inverse optimality problem for singularly perturbed systems

Finite-time Control of Discrete-time Positive Linear Systems via Convex Optimization

Optimal control of diffusion processes: $\infty$-order variational analysis and numerical solution