Abstract:Abstract. Agricultural nitrous oxide (N2O) emission accounts for a non-trivial fraction of global greenhouse gas (GHG) budget. To date, estimating N2O fluxes from cropland remains a challenging task because the related microbial processes (e.g., nitrification and denitrification) are controlled by complex interactions among climate, soil, plant and human activities. Existing approaches such as process-based (PB) models have well-known limitations due to insufficient representations of the processes or uncertainties of model parameters, and due to leverage recent advances in machine learning (ML) a new method is needed to unlock the “black box” to overcome its limitations such as low interpretability, out-of-sample failure and massive data demand. In this study, we developed a first-of-its-kind knowledge-guided machine learning model for agroecosystems (KGML-ag) by incorporating biogeophysical and chemical domain knowledge from an advanced PB model, ecosys, and tested it by comparing simulating daily N2O fluxes with real observed data from mesocosm experiments. The gated recurrent unit (GRU) was used as the basis to build the model structure. To optimize the model performance, we have investigated a range of ideas, including (1) using initial values of intermediate variables (IMVs) instead of time series as model input to reduce data demand; (2) building hierarchical structures to explicitly estimate IMVs for further N2O prediction; (3) using multi-task learning to balance the simultaneous training on multiple variables; and (4) pre-training with millions of synthetic data generated from ecosys and fine-tuning with mesocosm observations. Six other pure ML models were developed using the same mesocosm data to serve as the benchmark for the KGML-ag model. Results show that KGML-ag did an excellent job in reproducing the mesocosm N2O fluxes (overall r2=0.81, and RMSE=3.6 mgNm-2d-1 from cross validation). Importantly, KGML-ag always outperforms the PB model and ML models in predicting N2O fluxes, especially for complex temporal dynamics and emission peaks. Besides, KGML-ag goes beyond the pure ML models by providing more interpretable predictions as well as pinpointing desired new knowledge and data to further empower the current KGML-ag. We believe the KGML-ag development in this study will stimulate a new body of research on interpretable ML for biogeochemistry and other related geoscience processes.

Modeling N2O emissions with remotely sensed variables using machine learning

Machine learning reveals dynamic controls of soil nitrous oxide emissions from diverse long‐term cropping systems

Reevaluating the Drivers of Fertilizer-Induced N2O Emission: Insights from Interpretable Machine Learning.

Reevaluating the Drivers of Fertilizer-Induced N 2 O Emission: Insights from Interpretable Machine Learning

Modeling nitrous oxide emissions from agricultural soil incubation experiments using CoupModel

Modeling Nitrous Oxide Emissions From Large-Scale Intensive Cropping Systems in the Southern Amazon

Modeling nitrous oxide emissions from tile-drained winter wheat fields in Central France

Machine learning for predicting greenhouse gas emissions from agricultural soils

Model estimates of nitrous oxide emissions from agricultural lands in the United States

Process-based modeling of soil nitrous oxide emissions from United States corn fields under different management and climate scenarios coupled with evaluation using regional estimates

Machine learning for modeling N 2 O emissions from wastewater treatment plants: Aligning model performance, complexity, and interpretability

Evaluation of Four Modelling Approaches to Estimate Nitrous Oxide Emissions in China's Cropland.

Factors That Influence Nitrous Oxide Emissions from Agricultural Soils as Well as Their Representation in Simulation Models: A Review

Quantifying biological processes producing nitrous oxide in soil using a mechanistic model

Simulating the Impact of Management Practices on Nitrous Oxide Emissions

Estimating soil N 2 O emissions induced by organic and inorganic fertilizer inputs using a Tier-2, regression-based meta-analytic approach for U.S. agricultural lands

KGML-ag: a modeling framework of knowledge-guided machine learning to simulate agroecosystems: a case study of estimating N<sub>2</sub>O emission using data from mesocosm experiments

Developing a hybrid data-driven and informed model for prediction and mitigation of agricultural nitrous oxide flux hotspots

Hierarchical Bayesian Calibration of Nitrous Oxide (n2o) and Nitrogen Monoxide (no) Flux Module of an Agro-Ecosystem Model: Ecosse

Airborne Measurements Reveal High Spatiotemporal Variation and the Heavy‐Tail Characteristic of Nitrous Oxide Emissions in Iowa

A Process‐oriented Model of N2O and NO Emissions from Forest Soils: 1. Model Development