Learning-based agricultural management in partially observable environments subject to climate variability

Zhaoan Wang,Shaoping Xiao,Junchao Li,Jun Wang

2024-01-03

Abstract:Agricultural management, with a particular focus on fertilization strategies, holds a central role in shaping crop yield, economic profitability, and environmental sustainability. While conventional guidelines offer valuable insights, their efficacy diminishes when confronted with extreme weather conditions, such as heatwaves and droughts. In this study, we introduce an innovative framework that integrates Deep Reinforcement Learning (DRL) with Recurrent Neural Networks (RNNs). Leveraging the Gym-DSSAT simulator, we train an intelligent agent to master optimal nitrogen fertilization management. Through a series of simulation experiments conducted on corn crops in Iowa, we compare Partially Observable Markov Decision Process (POMDP) models with Markov Decision Process (MDP) models. Our research underscores the advantages of utilizing sequential observations in developing more efficient nitrogen input policies. Additionally, we explore the impact of climate variability, particularly during extreme weather events, on agricultural outcomes and management. Our findings demonstrate the adaptability of fertilization policies to varying climate conditions. Notably, a fixed policy exhibits resilience in the face of minor climate fluctuations, leading to commendable corn yields, cost-effectiveness, and environmental conservation. However, our study illuminates the need for agent retraining to acquire new optimal policies under extreme weather events. This research charts a promising course toward adaptable fertilization strategies that can seamlessly align with dynamic climate scenarios, ultimately contributing to the optimization of crop management practices.

Machine Learning

What problem does this paper attempt to address?

The paper attempts to address the issue of how to optimize nitrogen fertilizer application strategies in agricultural management under variable climate conditions using Deep Reinforcement Learning (DRL) and Recurrent Neural Networks (RNN). Specifically, the study aims to:

1. **Nitrogen Management in Partially Observable Environments**: Traditional agricultural management methods perform poorly under extreme weather conditions (such as heatwaves and droughts). The paper proposes a new framework that combines DRL with RNN, utilizing the Gym-DSSAT simulator to train intelligent agents to master optimal nitrogen fertilizer application strategies.

2. **Impact of Climate Variability**: The study explores the impact of climate variability (especially extreme weather events) on agricultural management and crop yield. Through a series of simulation experiments, it compares the performance of Partially Observable Markov Decision Process (POMDP) models and Fully Observable Markov Decision Process (MDP) models.

3. **Development of Adaptive Policies**: The research demonstrates that fixed policies show resilience in coping with minor climate changes under different climate conditions, but agents need to be retrained to obtain new optimal policies in the face of extreme weather events.

4. **Optimization of Crop Management Practices**: The study provides promising directions for fertilizer management strategies to adapt to dynamic climate scenarios, with the ultimate goal of optimizing crop management practices to improve crop yield, economic benefits, and environmental protection.

Through these efforts, the paper aims to provide a more flexible and efficient management method for agricultural production to cope with ever-changing climate conditions.