Abstract:Machine learning algorithms find frequent application in spatial prediction of biotic and abiotic environmental variables. However, the characteristics of spatial data, especially spatial autocorrelation, are widely ignored. We hypothesize that this is problematic and results in models that can reproduce training data but are unable to make spatial predictions beyond the locations of the training samples. We assume that not only spatial validation strategies but also spatial variable selection is essential for reliable spatial predictions. We introduce two case studies that use remote sensing to predict land cover and the leaf area index for the "Marburg Open Forest", an open research and education site of Marburg University, Germany. We use the machine learning algorithm Random Forests to train models using non-spatial and spatial cross-validation strategies to understand how spatial variable selection affects the predictions. Our findings confirm that spatial cross-validation is essential in preventing overoptimistic model performance. We further show that highly autocorrelated predictors (such as geolocation variables, e.g. latitude, longitude) can lead to considerable overfitting and result in models that can reproduce the training data but fail in making spatial predictions. The problem becomes apparent in the visual assessment of the spatial predictions that show clear artefacts that can be traced back to a misinterpretation of the spatially autocorrelated predictors by the algorithm. Spatial variable selection could automatically detect and remove such variables that lead to overfitting, resulting in reliable spatial prediction patterns and improved statistical spatial model performance. We conclude that in addition to spatial validation, a spatial variable selection must be considered in spatial predictions of ecological data to produce reliable predictions.

Spatial bagging to integrate spatial correlation into ensemble machine learning

An ensemble spatial prediction method considering geospatial heterogeneity

Adaptive Ensemble Learning of Spatiotemporal Processes with Calibrated Predictive Uncertainty: A Bayesian Nonparametric Approach

Bayesian Spatial Predictive Synthesis

Estimating the prediction performance of spatial models via spatial k-fold cross validation

Exploring the Efficacy of Statistical and Deep Learning Methods for Large Spatial Datasets: A Case Study

REDS: Random Ensemble Deep Spatial prediction

A Robust Prediction Model for Species Distribution Using Bagging Ensembles with Deep Neural Networks

A Nonparametric Algorithm for Spatially Dependent Functional Data: Bagging Voronoi for Clustering, Dimensional Reduction, and Regression

Augmenting correlation structures in spatial data using deep generative models

Ensembling geophysical models with Bayesian Neural Networks

Auxiliary-task learning for geographic data with autoregressive embeddings

The Third Competition on Spatial Statistics for Large Datasets

Importance of spatial predictor variable selection in machine learning applications -- Moving from data reproduction to spatial prediction

A Weighted Subspace Approach for Improving Bagging Performance

Geographically weighted regression with the integration of machine learning for spatial prediction

A Scalable Partitioned Approach to Model Massive Nonstationary Non-Gaussian Spatial Datasets

Unraveling near real-time spatial dynamics of population using geographical ensemble learning

Semiparametric Regression for Spatial Data via Deep Learning

Bayesian Gaussian models for interpolating large-dimensional data at misaligned areal units

Flexible Basis Representations for Modeling Large Non-Gaussian Spatial Data