Uncertainty Quantification of Soil Organic Carbon Estimation from Remote Sensing Data with Conformal Prediction

Nafiseh Kakhani,Setareh Alamdar,Ndiye Michael Kebonye,Meisam Amani,Thomas Scholten

DOI: https://doi.org/10.3390/rs16030438

IF: 5

2024-01-23

Remote Sensing

Abstract:Soil organic carbon (SOC) contents and stocks provide valuable insights into soil health, nutrient cycling, greenhouse gas emissions, and overall ecosystem productivity. Given this, remote sensing data coupled with advanced machine learning (ML) techniques have eased SOC level estimation while revealing its patterns across different ecosystems. However, despite these advances, the intricacies of training reliable and yet certain SOC models for specific end-users remain a great challenge. To address this, we need robust SOC uncertainty quantification techniques. Here, we introduce a methodology that leverages conformal prediction to address the uncertainty in estimating SOC contents while using remote sensing data. Conformal prediction generates statistically reliable uncertainty intervals for predictions made by ML models. Our analysis, performed on the LUCAS dataset in Europe and incorporating a suite of relevant environmental covariates, underscores the efficacy of integrating conformal prediction with another ML model, specifically random forest. In addition, we conducted a comparative assessment of our results against prevalent uncertainty quantification methods for SOC prediction, employing different evaluation metrics to assess both model uncertainty and accuracy. Our methodology showcases the utility of the generated prediction sets as informative indicators of uncertainty. These sets accurately identify samples that pose prediction challenges, providing valuable insights for end-users seeking reliable predictions in the complexities of SOC estimation.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve This paper aims to address the issue of quantifying uncertainty in the estimation of soil organic carbon (SOC) content. Specifically, the authors propose a method using **Conformal Prediction** to assess the uncertainty of SOC estimation results based on remote sensing data. The main problems the paper attempts to solve are as follows: 1. **Improving the Reliability of SOC Estimation**: - Although remote sensing technology and machine learning methods have made progress in SOC estimation, training reliable and highly certain SOC models for specific user needs remains challenging. - Existing methods have uncertainties in SOC estimation, necessitating a reliable technique to quantify these uncertainties. 2. **Improvement of Uncertainty Quantification Techniques**: - Propose a new method that combines conformal prediction with machine learning models like random forests to generate statistically reliable uncertainty intervals. - This approach allows for more accurate identification of samples that are difficult to predict, thereby providing users with more reliable SOC estimation results. 3. **Comparison with Other Uncertainty Quantification Methods**: - The study not only introduces the conformal prediction method but also compares its results with other commonly used uncertainty quantification methods. - Different evaluation metrics are used to assess the model's uncertainty and accuracy, demonstrating the effectiveness of the prediction sets generated by conformal prediction as indicators of uncertainty. Through this method, the paper aims to provide a new tool for the field of soil organic carbon estimation that is more transparent, interpretable, and performance-assured, thereby enhancing user confidence in the estimation results.

Uncertainty Quantification of Soil Organic Carbon Estimation from Remote Sensing Data with Conformal Prediction

Uncertainty quantification for probabilistic machine learning in earth observation using conformal prediction

Soil total and organic carbon mapping and uncertainty analysis using machine learning techniques

Prediction and Uncertainty Capabilities of Quantile Regression Forests in Estimating Spatial Distribution of Soil Organic Matter

SSL-SoilNet: A Hybrid Transformer-based Framework with Self-Supervised Learning for Large-scale Soil Organic Carbon Prediction

Reducing Uncertainties of Future Global Soil Carbon Responses to Climate and Land Use Change with Emergent Constraints

Predicting Soil Organic Carbon in Cultivated Land Across Geographical and Spatial Scales: Integrating Sentinel-2A and Laboratory Vis-NIR Spectra

Innovative approaches in soil carbon sequestration modelling for better prediction with limited data

A novel intelligence approach based active and ensemble learning for agricultural soil organic carbon prediction using multispectral and SAR data fusion

Using Machine-Learning Algorithms to Predict Soil Organic Carbon Content from Combined Remote Sensing Imagery and Laboratory Vis-NIR Spectral Datasets

A Unified Diagnostic Platform to Quantify the Source of Uncertainty in Modelling Global SOC Dynamics

Upscaling Soil Organic Carbon Measurements at the Continental Scale Using Multivariate Clustering Analysis and Machine Learning

Accurate Quantification of 0–30 cm Soil Organic Carbon in Croplands over the Continental United States Using Machine Learning

A Deep Learning Approach to Estimate Soil Organic Carbon from Remote Sensing

Using soil library hyperspectral reflectance and machine learning to predict soil organic carbon: Assessing potential of airborne and spaceborne optical soil sensing

Uncertainty Quantification of Surrogate Models using Conformal Prediction

Using Process-Oriented Model Output to Enhance Machine Learning-Based Soil Organic Carbon Prediction in Space and Time.

Digital Soil Mapping of Organic Carbon and It’s Spatial Distribution Uncertainty in Field Scale

Remote Quantification of Soil Organic Carbon: Role of Topography in the Intra-Field Distribution

Estimation of Soil Organic Carbon Content Based on Deep Learning and Quantile Regression