Abstract:Controlling greenhouse crop production systems is a complex task due to uncertain and non-linear dynamics between crops, indoor and outdoor climate, and economics. The declining number of skilled growers necessitates the development of autonomous greenhouse control systems. Reinforcement Learning (RL) is a promising approach that can learn a control policy to automate greenhouse management. RL optimises a control policy through interactions with a model of the greenhouse while guided by an economic-based reward function. However, its application to real-world systems is limited due to discrepancies between models and real-world dynamics. Moreover, RL controllers may struggle to maintain state constraints while optimising the primary objective, especially when models inadequately capture the adverse effects of constraint violations on crop growth. Also, the generalisation to novel states, for example, due to unseen weather trajectories, is underexplored in RL-based greenhouse control. This work addresses these challenges through three key contributions. First, we present GreenLight-Gym, the first open-source environment designed for training and evaluating RL algorithms on the state-of-the-art greenhouse model GreenLight. GreenLight-Gym enables the community to benchmark RL-based control methodologies. Second, we compare two reward-shaping approaches, using either a multiplicative or additive penalty, to enforce state boundaries. The additive penalty achieves more stable training while better adhering to state constraints, while the multiplicative penalty yields marginally higher profits. Finally, we evaluate RL performance on a disjoint training and testing weather dataset, demonstrating improved generalisation to unseen conditions. Our environment and experiment scripts are open-sourced, facilitating innovative research on learning-based greenhouse control.

Nitrogen management with reinforcement learning and crop growth models

Optimizing Nitrogen Management with Deep Reinforcement Learning and Crop Simulations

CropGym: a Reinforcement Learning Environment for Crop Management

Optimizing Crop Management with Reinforcement Learning and Imitation Learning

Learning-based agricultural management in partially observable environments subject to climate variability

A Comparative Study of Deep Reinforcement Learning for Crop Production Management

Machine Learning aided Crop Yield Optimization

A SWAT-based Reinforcement Learning Framework for Crop Management

The New Agronomists: Language Models are Experts in Crop Management

Breeding Programs Optimization with Reinforcement Learning

GreenLight-Gym: A Reinforcement Learning Benchmark Environment for Greenhouse Crop Production Control

gym-DSSAT: a crop model turned into a Reinforcement Learning environment

Integrating Reinforcement Learning and Large Language Models for Crop Production Process Management Optimization and Control through A New Knowledge-Based Deep Learning Paradigm

AgGym: An agricultural biotic stress simulation environment for ultra-precision management planning

Intelligent Agricultural Management Considering N$_2$O Emission and Climate Variability with Uncertainties

CROPS: A Deployable Crop Management System Over All Possible State Availabilities

Agricultural land use modeling and climate change adaptation: A reinforcement learning approach

Predicting site-specific economic optimal nitrogen rate using machine learning methods and on-farm precision experimentation

Comparative Analysis of Multi-Agent Reinforcement Learning Policies for Crop Planning Decision Support

Crop Yield Prediction Using Deep Reinforcement Learning Model for Sustainable Agrarian Applications

Robust Model-based Reinforcement Learning for Autonomous Greenhouse Control