Abstract:SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 699-723, February 2024. The use of coordinate processes for the modeling of impulse control for general Markov processes typically involves the construction of a probability measure on a countable product of copies of the path space. In addition, admissibility of an impulse control policy requires that the random times of the interventions be stopping times with respect to different filtrations arising from the different component coordinate processes. When the underlying Markov process has continuous paths, however, a simpler model can be developed which takes the single path space as its probability space and uses the natural filtration with respect to which the intervention times must be stopping times. Moreover, this model construction allows for impulse control with random effects whereby the decision maker selects a distribution of the new state. This paper gives the construction of the probability measure on the path space for an admissible intervention policy subject to a randomized impulse mechanism. In addition, a class of polices is defined for which the paths between interventions are independent and a further subclass for which the cycles following the initial cycle are identically distributed. A benefit of this smaller subclass of policies is that one is allowed to use classical renewal arguments to analyze long-term average control problems. Further, the paper defines a class of stationary impulse policies for which the family of models gives a Markov family. The decision to use an [math] ordering policy in inventory management provides an example of an impulse policy for which the process has independent and identically distributed cycles and the family of models forms a Markov family.

On an Approximation of Average Cost per Unit Time Impulse Control of Markov Processes

Lmi Approach To Optimal Guaranteed Cost Control For A Class Of Linear Uncertain Discrete Systems

Impulse approximate controllability for stochastic evolution equations and its applications

Average cost optimal control under weak ergodicity hypotheses: Relative value iterations

Optimal strategies for impulse control of piecewise deterministic Markov processes

On the Modeling of Impulse Control with Random Effects for Continuous Markov Processes

Stochastic control up to a hitting time: optimality and rolling-horizon implementation

Long-Run Impulse Control with Generalized Discounting

Average Continuous Control of Piecewise Deterministic Markov Processes

On the Modelling of Impulse Control with Random Effects for Continuous Markov Processes

Nonparametric learning for impulse control problems

ON GRADUAL-IMPULSE CONTROL OF CONTINUOUS-TIME MARKOV DECISION PROCESSES WITH EXPONENTIAL UTILITY

The Solution to an Impulse Control Problem Motivated by Optimal Harvesting

Brief paper: Stochastic minimax control for stabilizing uncertain quasi- integrable Hamiltonian systems

Impulse Control of Conditional McKean–Vlasov Jump Diffusions

Optimal control formulation of transition path problems for Markov Jump Processes

Long Run Stochastic Control Problems with General Discounting

Consistent Approximations to Impulsive Optimal Control Problems

Average Cost Minimization Problems Subject to State Constraints

Optimal Control of Brownian Inventory Models with Convex Holding Cost: Average Cost Case

OPTIMALITY STRATEGY OF AVERAGE COST BASED PERFORMANCE POTENTIALS FOR MARKOV CONTROL PROCESS