Abstract:We derive the explicit solutions to singular stochastic control problems of the monotone follower type with (a) an expected discounted criterion, (b) an expected ergodic criterion and (c) a pathwise ergodic criterion. These problems have been motivated by the optimal sustainable exploitation of an ecosystem, such as a natural fishery. Under general assumptions on the diffusion coefficients, the discounting rate function, the running payoff function and the marginal profit of control action, we show that the optimal strategies are of a threshold type. We solve the three problems by first constructing suitable solutions to their associated HJB equations, which take the form of quasi-variational inequalities with gradient constraints. In the cases of the ergodic control problems, we also use a suitable new variational argument. Furthermore, we establish the convergence of the solution of the discounted control problem to the one of the ergodic control problems as the discounting rate function tends to 0 in an Abelian sense.
What problem does this paper attempt to address?
This paper aims to solve the optimal control problem in the sustainable development of ecosystems. Specifically, the paper explores how to achieve the long - term sustainable use of ecosystems through optimal control strategies in consideration of the dynamic changes of ecosystems. For example, for the management of natural fishery resources, the paper attempts to find an optimal fishing strategy that can ensure the continuous use of fishery resources and maximize economic benefits at the same time.
### Background and Motivation of the Paper
The paper mainly focuses on Singular Stochastic Control Problems, which are of great significance in ecosystem management. The number of species in an ecosystem is usually affected by random factors, such as weather changes, disease spread, etc. Therefore, how to formulate the optimal resource management strategy under the influence of these random factors is an important research topic.
### Research Methods
The paper uses three different performance indicators to evaluate the effectiveness of control strategies:
1. **Expected Discounted Performance Index**: It takes into account the discounted value of future earnings.
2. **Expected Long - Term Average Performance Index**: It takes into account the long - term average earnings.
3. **Pathwise Long - Term Average Performance Criterion**: It takes into account the long - term average earnings on the path.
### Main Contributions
1. **Derivation of Explicit Solutions**: The paper derives the explicit solutions of the HJB equations (Hamilton - Jacobi - Bellman Equation) corresponding to the above three performance indicators. The forms of these solutions are more complex than those in previous studies, involving integral equations rather than algebraic equations.
2. **Threshold - type Optimal Strategy**: The paper proves that under general assumptions, the optimal strategy is usually of the threshold - type, that is, when the system state exceeds a certain threshold, take some action, otherwise do not take action.
3. **Convergence Analysis**: The paper also analyzes how the solution of the discounted control problem converges to the solution of the long - term average control problem when the discount rate function approaches zero.
### Mathematical Models
The mathematical models involved in the paper mainly include:
- **State Process**: A stochastic differential equation (SDE) that describes the number of species in an ecosystem.
- **Control Process**: A control process that describes the amount of fishing or intervention measures.
- **Performance Indicator**: Used to evaluate the performance of different control strategies.
### Conclusion
Through the above research, the paper provides a theoretical framework for ecosystem management, which can guide resource management decisions in practice. In particular, the threshold - type optimal strategy in the paper provides clear guidance for practical operations and helps to achieve the sustainable use of ecosystems.
### Examples of Formulas
The following are some key formulas in the paper:
1. **Stochastic Differential Equation of the State Process**:
\[
dX_t^\zeta = b(X_t^\zeta) dt - d\zeta_t + \sigma(X_t^\zeta) dW_t, \quad X_0^\zeta = x > 0
\]
2. **Expected Discounted Performance Index**:
\[
I_x(\zeta) = E_x \left[ \int_0^\infty e^{-\Lambda_t^\zeta} h(X_t^\zeta) dt + \int_0^\infty e^{-\Lambda_t^\zeta} k(X_t^\zeta) \circ d\zeta_t \right]
\]
3. **Expected Long - Term Average Performance Index**:
\[
J_e^x(\zeta) = \limsup_{T \to \infty} \frac{1}{T} E \left[ \int_0^T h(X_t^\zeta) dt + \int