Abstract:Optimal control theory deals with finding protocols to steer a system between assigned initial and final states, such that a trajectory-dependent cost function is minimized. The application of optimal control to stochastic systems is an open and challenging research frontier, with a spectrum of applications ranging from stochastic thermodynamics to biophysics and data science. Among these, the design of nanoscale electronic components motivates the study of underdamped dynamics. In this work, we develop analytic techniques to determine protocols steering finite time transitions at a minimum thermodynamic cost for stochastic underdamped dynamics. As cost functions, we consider two paradigmatic thermodynamic indicators. The first is the Kullback-Leibler divergence between the probability measure of the controlled process and that of a reference process. The corresponding optimization problem is the underdamped version of the Schrödinger diffusion problem that has been widely studied in the overdamped regime. The second is the mean entropy production during the transition, corresponding to the second law of modern stochastic thermodynamics. For transitions between Gaussian states, we show that optimal protocols satisfy a Lyapunov equation, a central tool in stability analysis of dynamical systems. For transitions between states described by general Maxwell-Boltzmann distributions, we introduce an infinite-dimensional version of the Poincaré-Linstedt multiscale perturbation theory around the overdamped limit. This technique fundamentally improves the standard multiscale expansion. Indeed, it enables the explicit computation of momentum cumulants, whose variation in time is a distinctive trait of underdamped dynamics and is directly accessible to experimental observation.

Stability analysis of optimal control problems with time-dependent costs

Guaranteed Cost D-Stabilization And H-Infinity D-Stabilization For Linear Discrete Time-Delay Systems

Generalized guaranteed cost control with D-stability and multiple output constraints.

Guaranteed cost D-stabilization and H∞ D-stabilization for linear discrete time-delay systems

Optimal Guaranteed Cost Control for a Class of Linear Uncertain Time-Delay Systems

The necessary and sufficient conditions for stochastic differential systems with multi-time states cost functional

A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Analysis of the vanishing discount limit for optimal control problems in continuous and discrete time

New results on delay‐dependent stability analysis and stabilization for stochastic time‐delay systems

Time-Inconsistent Stochastic Optimal Control Problems and Backward Stochastic Volterra Integral Equations

An Optimal Solution to Infinite Horizon Nonlinear Control Problems: Part II

Optimal Control for a Class of Infinite Dimensional Systems Involving an $L^\infty$-term in the Cost Functional

Near-Optimal Control for Time-Varying Linear Discrete Systems with Additive Nonlinearities and Random Gains

Optimal control on finite graphs: asymptotic optimal controls and ergodic constant in the case of entropic costs

A Multilevel Approach for Stochastic Nonlinear Optimal Control

Optimal Control of Discrete-Time Nonlinear Systems

Discrete-Time Hybrid Control Processes with Unbounded Costs

Regularity of Optimal Solutions and the Optimal Cost for Hybrid Dynamical Systems via Reachability Analysis

Optimal Control of Underdamped Systems: An Analytic Approach

A stochastic hybrid optimal control with regime switching and recursive cost functional

Mixed Deterministic and Random Optimal Control of Linear Stochastic Systems with Quadratic Costs