On Optimal Harvesting Problems in Random Environments

Qingshuo Song,Richard Stockbridge,Chao Zhu
DOI: https://doi.org/10.1137/100797333
2014-09-28
Abstract:This paper investigates the optimal harvesting strategy for a single species living in random environments whose growth is given by a regime-switching diffusion. Harvesting acts as a (stochastic) control on the size of the population. The objective is to find a harvesting strategy which maximizes the expected total discounted income from harvesting {\em up to the time of extinction} of the species; the income rate is allowed to be state- and environment-dependent. This is a singular stochastic control problem with both the extinction time and the optimal harvesting policy depending on the initial condition. One aspect of receiving payments up to the random time of extinction is that small changes in the initial population size may significantly alter the extinction time when using the same harvesting policy. Consequently, one no longer obtains continuity of the value function using standard arguments for either regular or singular control problems having a fixed time horizon. This paper introduces a new sufficient condition under which the continuity of the value function for the regime-switching model is established. Further, it is shown that the value function is a viscosity solution of a coupled system of quasi-variational inequalities. The paper also establishes a verification theorem and, based on this theorem, an $\varepsilon$-optimal harvesting strategy is constructed under certain conditions on the model. Two examples are analyzed in detail.
Optimization and Control,Probability,Populations and Evolution
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the optimal capture strategy for a single species in a stochastic environment. Specifically, this research focuses on the species growth model under the influence of stochastic environments (such as weather changes or human factors), and the changes in these environments will cause sudden changes in the growth rate and carrying capacity of the species. Therefore, the capture behavior, as a control means, not only affects the population quantity but also brings economic benefits. The goal of the paper is to find a capture strategy that maximizes the expected total discounted income obtained from the capture until the species quantity drops to a certain threshold (such as extinction). This involves a singular stochastic control problem, in which the optimal capture strategy may not be an absolutely continuous function of time. ### Main problem description 1. **Species growth in a stochastic environment**: The growth of species is affected by stochastic fluctuations, and sudden changes in the environment (such as sudden changes in growth rate and carrying capacity) also affect its dynamics. 2. **Capture strategy as a control means**: Introduce a capture strategy to obtain economic benefits and control the population quantity. 3. **Goal**: Find a capture strategy that maximizes the expected total discounted income obtained from the capture until the species quantity drops to a certain threshold (such as extinction). ### Mathematical model and method - **Stochastic differential equation**: The evolution of the species quantity \( X(t) \) is described by the stochastic differential equation: \[ dX(t) = b(X(t), \alpha(t)) dt + \sigma(X(t), \alpha(t)) dw(t), \] where \( w(t) \) is a standard Brownian motion, and \( \alpha(t) \) is a continuous - time Markov chain with a finite state, representing the environmental state. - **Species quantity after capture**: If the capture strategy \( Z(t) \) is applied, the species quantity \( \hat{X}(t) \) after capture satisfies: \[ d\hat{X}(t) = b(\hat{X}(t), \alpha(t)) dt + \sigma(\hat{X}(t), \alpha(t)) dw(t)-dZ(t). \] - **Value function**: The goal is to maximize the expected total discounted income: \[ V(x, \alpha)=\sup_{Z \in A} J(x, \alpha, Z), \] where \( J(x, \alpha, Z) \) represents the expected total discounted income obtained from the capture: \[ J(x, \alpha, Z)=E_{x, \alpha}\left[\int_{0}^{\tau} e^{-rs} f(\hat{X}(s -), \alpha(s -)) dZ(s)\right], \] \( r \) is the discount factor, \( \tau \) is the extinction time, and \( f(x, \alpha) \) is the marginal benefit of capture. ### Main contributions 1. **Verification theorem**: Prove a verification theorem for constructing an ε - optimal capture strategy. 2. **Continuity condition**: Propose a new sufficient condition to ensure the continuity of the value function. 3. **Numerical solution**: Prove that the value function is a viscosity solution of the coupled quasi - variational inequality system. Through these methods, the paper solves the complex problem of determining the optimal capture strategy in a stochastic environment and provides a theoretical basis for practical applications.