Abstract:The goal of this thesis is to provide efficient and provably convergent numerical methods for solving partial differential equations (PDEs) coming from impulse control problems motivated by finance. Impulses, which are controlled jumps in a stochastic process, are used to model realistic features in financial problems which cannot be captured by ordinary stochastic controls. The dynamic programming equations associated with impulse control problems are Hamilton-Jacobi-Bellman quasi-variational inequalities (HJBQVIs) Other than in certain special cases, the numerical schemes that come from the discretization of HJBQVIs take the form of complicated nonlinear matrix equations also known as Bellman problems. We prove that a policy iteration algorithm can be used to compute their solutions. In order to do so, we employ the theory of weakly chained diagonally dominant (w.c.d.d.) matrices. As a byproduct of our analysis, we obtain some new results regarding a particular family of Markov decision processes which can be thought of as impulse control problems on a discrete state space and the relationship between w.c.d.d. matrices and M-matrices. Since HJBQVIs are nonlocal PDEs, we are unable to directly use the seminal result of Barles and Souganidis (concerning the convergence of monotone, stable, and consistent numerical schemes to the viscosity solution) to prove the convergence of our schemes. We address this issue by extending the work of Barles and Souganidis to nonlocal PDEs in a manner general enough to apply to HJBQVIs. We apply our schemes to compute the solutions of various classical problems from finance concerning optimal control of the exchange rate, optimal consumption with fixed and proportional transaction costs, and guaranteed minimum withdrawal benefits in variable annuities.

Finite Horizon Stochastic Optimal Switching and Impulse Controls with a Viscosity Solution Approach

A stochastic hybrid optimal control with regime switching and recursive cost functional

Path-Dependent Optimal Stochastic Control and Viscosity Solution of Associated Bellman Equations

Impulse Control of Multi-dimensional Jump Diffusions in Finite Time Horizon

Stochastic optimal control problems with delays in the state and in the control via viscosity solutions and applications to optimal advertising and optimal investment problems

Optimal control of stochastic differential equations with random impulses and the Hamilton–Jacobi–Bellman equation

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

Time-Inconsistent Stochastic Optimal Control Problems and Backward Stochastic Volterra Integral Equations

Finite-time Stability and Stabilization of Markovian Switching Stochastic Systems with Impulsive Effects

Stochastic Recursive Optimal Control of McKean-Vlasov Type: A Viscosity Solution Approach

Impulse Control in Finance: Numerical Methods and Viscosity Solutions

Infinite time horizon stochastic recursive control problems with jumps: dynamic programming and stochastic verification theorems

Impulsive optimal control problems with time delays in the drift term

Optimal control of impulsive Volterra equations with variable impulse times

Optimal Control of Unbounded Functional Stochastic Evolution Systems in Hilbert Spaces: Second-Order Path-dependent HJB Equation

Optimal Control of Uncertain Stochastic Systems with Markovian Switching and Its Applications to Portfolio Decisions

Impulse approximate controllability for stochastic evolution equations and its applications

Relationship between General MP and DPP for the Stochastic Recursive Optimal Control Problem With Jumps: Viscosity Solution Framework

Viscosity solutions for mean field optimal switching with a two-time-scale Markov chain

The Maximum Principle for Discounted Optimal Control of Partially Observed Forward-Backward Stochastic Systems with Jumps on Infinite Horizon

A Viscosity Solution Theory of Stochastic Hamilton-Jacobi-Bellman equations in the Wasserstein Space