Abstract:Analysis of geospatial data has traditionally been model-based, with a mean model, customarily specified as a linear regression on the covariates, and a Gaussian process covariance model, encoding the spatial dependence. While nonlinear machine learning algorithms like neural networks are increasingly being used for spatial analysis, current approaches depart from the model-based setup and cannot explicitly incorporate spatial covariance. We propose NN-GLS , embedding neural networks directly within the traditional Gaussian process (GP) geostatistical model to accommodate nonlinear mean functions while retaining all other advantages of GP, like explicit modeling of the spatial covariance and predicting at new locations via kriging. In NN-GLS, estimation of the neural network parameters for the nonlinear mean of the Gaussian Process explicitly accounts for the spatial covariance through use of the generalized least squares (GLS) loss, thus, extending the linear case. We show that NN-GLS admits a representation as a special type of graph neural network (GNN). This connection facilitates the use of standard neural network computational techniques for irregular geospatial data, enabling novel and scalable mini-batching, backpropagation, and kriging schemes. We provide methodology to obtain uncertainty bounds for estimation and predictions from NN-GLS. Theoretically, we show that NN-GLS will be consistent for irregularly observed spatially correlated data processes. We also provide a finite sample concentration rate, which quantifies the need to accurately model the spatial covariance in neural networks for dependent data. To our knowledge, these are the first large-sample results for any neural network algorithm for irregular spatial data. We demonstrate the methodology through numerous simulations and an application to air pollution modeling. We develop a software implementation of NN-GLS in the Python package geospaNN. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Comparison of Kriging and artificial neural network models for the prediction of spatial data

A Generalized Spatial Autoregressive Neural Network Method for Three-Dimensional Spatial Interpolation

Hybrid MLP-IDW approach based on nearest neighbor for spatial prediction

A comparison of apartment rent price prediction using a large dataset: Kriging versus DNN

Neural network ensemble residual kriging application for spatial variability of soil properties

Artificial neural networks as a tool for spatial interpolation

On Cokriging, Neural Networks, and Spatial Blind Source Separation for Multivariate Spatial Prediction

Nonparametric spatial autoregressive model using deep neural networks

Graph convolutional networks for spatial interpolation of correlated data

k-nearest neighbors prediction and classification for spatial data

The role of artificial neural network and machine learning in utilizing spatial information

Comparison of spatial interpolation methods based on ArcGIS

DKNN: deep kriging neural network for interpretable geospatial interpolation

Estimating the prediction performance of spatial models via spatial k-fold cross validation

Neural Networks for Geospatial Data

Partially Specified Spatial Autoregressive Model with Artificial Neural Network

Comparative analysis of support vector machine and artificial neural network models for soil cation exchange capacity prediction

DEVELOPMENT OF METHODS BASED ON NEURAL NETWORKS IN THE ESTIMATION OF MINERAL RESOURCES

Use of Genetic-Algorithm-optimized Back Propagation Neural Network and Ordinary Kriging for Predicting the Spatial Distribution of Groundwater Quality Parameter

Spatial Aggregation and Temporal Convolution Networks for Real-time Kriging

On the suitability of generalized regression neural networks for GNSS position time series prediction for geodetic applications in geodesy and geophysics