Abstract:Controlling greenhouse crop production systems is a complex task due to uncertain and non-linear dynamics between crops, indoor and outdoor climate, and economics. The declining number of skilled growers necessitates the development of autonomous greenhouse control systems. Reinforcement Learning (RL) is a promising approach that can learn a control policy to automate greenhouse management. RL optimises a control policy through interactions with a model of the greenhouse while guided by an economic-based reward function. However, its application to real-world systems is limited due to discrepancies between models and real-world dynamics. Moreover, RL controllers may struggle to maintain state constraints while optimising the primary objective, especially when models inadequately capture the adverse effects of constraint violations on crop growth. Also, the generalisation to novel states, for example, due to unseen weather trajectories, is underexplored in RL-based greenhouse control. This work addresses these challenges through three key contributions. First, we present GreenLight-Gym, the first open-source environment designed for training and evaluating RL algorithms on the state-of-the-art greenhouse model GreenLight. GreenLight-Gym enables the community to benchmark RL-based control methodologies. Second, we compare two reward-shaping approaches, using either a multiplicative or additive penalty, to enforce state boundaries. The additive penalty achieves more stable training while better adhering to state constraints, while the multiplicative penalty yields marginally higher profits. Finally, we evaluate RL performance on a disjoint training and testing weather dataset, demonstrating improved generalisation to unseen conditions. Our environment and experiment scripts are open-sourced, facilitating innovative research on learning-based greenhouse control.

gym-DSSAT: a crop model turned into a Reinforcement Learning environment

A Comparative Study of Deep Reinforcement Learning for Crop Production Management

Optimizing Nitrogen Management with Deep Reinforcement Learning and Crop Simulations

Nitrogen management with reinforcement learning and crop growth models

Optimizing Crop Management with Reinforcement Learning and Imitation Learning

SDGym: Low-Code Reinforcement Learning Environments using System Dynamics Models

Machine Learning aided Crop Yield Optimization

A SWAT-based Reinforcement Learning Framework for Crop Management

GreenLight-Gym: A Reinforcement Learning Benchmark Environment for Greenhouse Crop Production Control

Learning-based agricultural management in partially observable environments subject to climate variability

The New Agronomists: Language Models are Experts in Crop Management

CropGym: a Reinforcement Learning Environment for Crop Management

Breeding Programs Optimization with Reinforcement Learning

Integrating Reinforcement Learning and Large Language Models for Crop Production Process Management Optimization and Control through A New Knowledge-Based Deep Learning Paradigm

Crop Yield Prediction Using Deep Reinforcement Learning Model for Sustainable Agrarian Applications

Deep Reinforcement Learning for Greenhouse Climate Control

Gymnasium: A Standard Interface for Reinforcement Learning Environments

Curriculum-RL Based Air Combat Decision-Making

Robust Model-based Reinforcement Learning for Autonomous Greenhouse Control

EduGym: An Environment and Notebook Suite for Reinforcement Learning Education

Gym-ANM: Open-source software to leverage reinforcement learning for power system management in research and education