Abstract:<p>While the application of machine-learning algorithms has been highly simplified in the last years due to their well-documented integration in commonly used statistical programming languages (such as R or Python), there are several practical challenges in the field of ecological modeling related to unbiased performance estimation. One is the influence of spatial autocorrelation in both hyperparameter tuning and performance estimation. Grouped cross-validation strategies have been proposed in recent years in environmental as well as medical contexts to reduce bias in predictive performance. In this study we show the effects of spatial autocorrelation on hyperparameter tuning and performance estimation by comparing several widely used machine-learning algorithms such as boosted regression trees (BRT), k-nearest neighbor (KNN), random forest (RF) and support vector machine (SVM) with traditional parametric algorithms such as logistic regression (GLM) and semi-parametric ones like generalized additive models (GAM) in terms of predictive performance. Spatial and non-spatial cross-validation methods were used to evaluate model performances aiming to obtain bias-reduced performance estimates. A detailed analysis on the sensitivity of hyperparameter tuning when using different resampling methods (spatial/non-spatial) was performed. As a case study the spatial distribution of forest disease (<em>Diplodia sapinea</em>) in the Basque Country (Spain) was investigated using common environmental variables such as temperature, precipitation, soil and lithology as predictors. Random Forest (mean Brier score estimate of 0.166) outperformed all other methods with regard to predictive accuracy. Though the sensitivity to hyperparameter tuning differed between the ML algorithms, there were in most cases no substantial differences between spatial and non-spatial partitioning for hyperparameter tuning. However, spatial hyperparameter tuning maintains consistency with spatial estimation of classifier performance and should be favored over non-spatial hyperparameter optimization. High performance differences (up to 47%) between the bias-reduced (spatial cross-validation) and overoptimistic (non-spatial cross-validation) cross-validation settings showed the high need to account for the influence of spatial autocorrelation. Overoptimistic performance estimates may lead to false actions in ecological decision making based on biased model predictions.</p>

Classification of Urban Green Space Types Using Machine Learning Optimized by Marine Predators Algorithm

A Model For The Evaluation Of Urban Green Spaces' System Using Rs And Gis Methods

Performance evaluation and hyperparameter tuning of statistical and machine-learning models using spatial data

Comparison of Common Machine Learning Algorithms Trained with Multi-Zone Models for Identifying the Location and Strength of Indoor Pollutant Sources

Hyperparameter tuning and performance assessment of statistical and machine-learning algorithms using spatial data

Classification of Street Tree Species Using UAV Tilt Photogrammetry

Exploitation of Time Series Sentinel-2 Data and Different Machine Learning Algorithms for Detailed Tree Species Classification.

Fine-Scale Mangrove Species Classification Based on UAV Multispectral and Hyperspectral Remote Sensing Using Machine Learning

Optimal Models for Plant Disease and Pest Detection Using UAV Image

Sentinel-2 Satellite Imagery for Urban Land Cover Classification by Optimized Random Forest Classifier

Artificial Intelligence and Urban Green Space Facilities Optimization Using the LSTM Model: Evidence from China

Improving Forest Above-Ground Biomass Estimation by Integrating Individual Machine Learning Models

A novel hybrid model for species distribution prediction using neural networks and Grey Wolf Optimizer algorithm

Performance Evaluation of Sentinel-2 and Landsat 8 OLI Data for Land Cover/Use Classification Using a Comparison between Machine Learning Algorithms

Modified Marine Predators Algorithm hybridized with teaching-learning mechanism for solving optimization problems

Aesthetic preference and mental restoration prediction in urban parks: An application of environmental modeling approach

Classification and Recognition of Building Appearance Based on Optimized Gradient-Boosted Decision Tree Algorithm

Urban Tree Classification Based on Object-Oriented Approach and Random Forest Algorithm Using Unmanned Aerial Vehicle (UAV) Multispectral Imagery

Marine Predators Algorithm: A nature-inspired metaheuristic

An Evaluation of Eight Machine Learning Regression Algorithms for Forest Aboveground Biomass Estimation from Multiple Satellite Data Products

A Novel Intelligent Classification Method for Urban Green Space Based on High-Resolution Remote Sensing Images