Abstract:Random forest and similar Machine Learning techniques are already used to generate spatial predictions, but spatial location of points (geography) is often ignored in the modeling process. Spatial auto-correlation, especially if still existent in the cross-validation residuals, indicates that the predictions are maybe biased, and this is suboptimal. This paper presents a random forest for spatial predictions framework (RFsp) where buffer distances from observation points are used as explanatory variables, thus incorporating geographical proximity effects into the prediction process. The RFsp framework is illustrated with examples that use textbook datasets and apply spatial and spatio-temporal prediction to numeric, binary, categorical, multivariate and spatiotemporal variables. Performance of the RFsp framework is compared with the state-of-the-art kriging techniques using fivefold cross-validation with refitting. The results show that RFsp can obtain equally accurate and unbiased predictions as different versions of kriging. Advantages of using RFsp over kriging are that it needs no rigid statistical assumptions about the distribution and stationarity of the target variable, it is more flexible towards incorporating, combining and extending covariates of different types, and it possibly yields more informative maps characterizing the prediction error. RFsp appears to be especially attractive for building multivariate spatial prediction models that can be used as “knowledge engines” in various geoscience fields. Some disadvantages of RFsp are the exponentially growing computational intensity with increase of calibration data and covariates and the high sensitivity of predictions to input data quality. The key to the success of the RFsp framework might be the training data quality—especially quality of spatial sampling (to minimize extrapolation problems and any type of bias in data), and quality of model validation (to ensure that accuracy is not effected by overfitting). For many data sets, especially those with lower number of points and covariates and close-to-linear relationships, model-based geostatistics can still lead to more accurate predictions than RFsp.

REDS: Random Ensemble Deep Spatial prediction

A Truly Spatial Random Forests Algorithm for Geoscience Data Analysis and Modelling

Deep Random Features for Scalable Interpolation of Spatiotemporal Data

Spatial Prediction Using Kriging Ensemble

Predicting extreme events from data using deep machine learning: when and where

Exploring the Efficacy of Statistical and Deep Learning Methods for Large Spatial Datasets: A Case Study

Random forest as a generic framework for predictive modeling of spatial and spatio-temporal variables

Semiparametric Regression for Spatial Data via Deep Learning

Deep Spatial Prediction via Heterogeneous Multi-Source Self-Supervision

Spatial Deep Convolutional Neural Networks

An ensemble spatial prediction method considering geospatial heterogeneity

Spatial bagging to integrate spatial correlation into ensemble machine learning

GSEN: an Ensemble Deep Learning Benchmark Model for Urban Hotspots Spatiotemporal Prediction.

A Random Approximate Reduct-Based Ensemble Learning Approach and Its Application in Software Defect Prediction

Dimension Reduction for Spatially Correlated Data: Spatial Predictor Envelope

Short-term Data-Based Spatial Parallel Autoreservoir Computing on Spatiotemporally Chaotic System Prediction

A Low Rank Gaussian Process Prediction Model for Very Large Datasets

The Random Hivemind: An Ensemble Deep Learner Application to Solar Energetic Particle Prediction Problem

Photometric redshift estimation via deep learning

Unsupervised Representation Learning by Predicting Random Distances

Regionalization in a global hydrologic deep learning model: From physical descriptors to random vectors