Abstract:Random forest and similar Machine Learning techniques are already used to generate spatial predictions, but spatial location of points (geography) is often ignored in the modeling process. Spatial auto-correlation, especially if still existent in the cross-validation residuals, indicates that the predictions are maybe biased, and this is suboptimal. This paper presents a random forest for spatial predictions framework (RFsp) where buffer distances from observation points are used as explanatory variables, thus incorporating geographical proximity effects into the prediction process. The RFsp framework is illustrated with examples that use textbook datasets and apply spatial and spatio-temporal prediction to numeric, binary, categorical, multivariate and spatiotemporal variables. Performance of the RFsp framework is compared with the state-of-the-art kriging techniques using fivefold cross-validation with refitting. The results show that RFsp can obtain equally accurate and unbiased predictions as different versions of kriging. Advantages of using RFsp over kriging are that it needs no rigid statistical assumptions about the distribution and stationarity of the target variable, it is more flexible towards incorporating, combining and extending covariates of different types, and it possibly yields more informative maps characterizing the prediction error. RFsp appears to be especially attractive for building multivariate spatial prediction models that can be used as “knowledge engines” in various geoscience fields. Some disadvantages of RFsp are the exponentially growing computational intensity with increase of calibration data and covariates and the high sensitivity of predictions to input data quality. The key to the success of the RFsp framework might be the training data quality—especially quality of spatial sampling (to minimize extrapolation problems and any type of bias in data), and quality of model validation (to ensure that accuracy is not effected by overfitting). For many data sets, especially those with lower number of points and covariates and close-to-linear relationships, model-based geostatistics can still lead to more accurate predictions than RFsp.

Targeting predictors in random forest regression

Common, uncommon, and novel applications of random forest in psychological research

Effect of hyperparameters on variable selection in random forests

Random forest as a generic framework for predictive modeling of spatial and spatio-temporal variables

Unsupervised Learning With Random Forest Predictors

binomialRF: interpretable combinatoric efficiency of random forests to identify biomarker interactions

Hyperparameters and tuning strategies for random forest

Understanding overfitting in random forest for probability estimation: a visualization and simulation study

Predicting United States policy outcomes with Random Forests

Random Forests: some methodological insights

Enhanced Local Explainability and Trust Scores with Random Forest Proximities

Random forest versus logistic regression: a large-scale benchmark experiment

Optimal Weighted Random Forests

Random Forest (RF) Kernel for Regression, Classification and Survival

Forecasting the direction of the Fed's monetary policy decisions using random forest

Random Forests for dependent data

Comparing Targeting Strategies for Maximizing Social Welfare with Limited Resources

Boosting Random Forests to Reduce Bias; One-Step Boosted Forest and Its Variance Estimate

Target Aggregation Regression Based on Random Forests

Extremal Random Forests

A Random-effects Approach to Regression Involving Many Categorical Predictors and Their Interactions