Abstract:Analysis of geospatial data has traditionally been model-based, with a mean model, customarily specified as a linear regression on the covariates, and a Gaussian process covariance model, encoding the spatial dependence. While nonlinear machine learning algorithms like neural networks are increasingly being used for spatial analysis, current approaches depart from the model-based setup and cannot explicitly incorporate spatial covariance. We propose NN-GLS , embedding neural networks directly within the traditional Gaussian process (GP) geostatistical model to accommodate nonlinear mean functions while retaining all other advantages of GP, like explicit modeling of the spatial covariance and predicting at new locations via kriging. In NN-GLS, estimation of the neural network parameters for the nonlinear mean of the Gaussian Process explicitly accounts for the spatial covariance through use of the generalized least squares (GLS) loss, thus, extending the linear case. We show that NN-GLS admits a representation as a special type of graph neural network (GNN). This connection facilitates the use of standard neural network computational techniques for irregular geospatial data, enabling novel and scalable mini-batching, backpropagation, and kriging schemes. We provide methodology to obtain uncertainty bounds for estimation and predictions from NN-GLS. Theoretically, we show that NN-GLS will be consistent for irregularly observed spatially correlated data processes. We also provide a finite sample concentration rate, which quantifies the need to accurately model the spatial covariance in neural networks for dependent data. To our knowledge, these are the first large-sample results for any neural network algorithm for irregular spatial data. We demonstrate the methodology through numerous simulations and an application to air pollution modeling. We develop a software implementation of NN-GLS in the Python package geospaNN. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Locally Supervised Neural Networks for Approximating Terramechanics Models

Nonlinear semi-parametric modeling method based on GA-ANN

Neural Networks for Geospatial Data

A Two-Stage Spatial Prediction Modeling Approach Based on Graph Neural Networks and Neural Processes

Geographically and temporally neural network weighted regression for modeling spatiotemporal non-stationary relationships

Data-Driven Predictive Model Based on Locally Weighted Bayesian Gaussian Regression

Double Neural Networks Enhanced Global Mobility Prediction Model for Unmanned Ground Vehicles in Off-Road Environments

Leveraging Locality and Robustness to Achieve Massively Scalable Gaussian Process Regression

Diagonal Recurrent Neural Networks for Parameters Identification of Terrain Based on Wheel–soil Interaction Analysis

Further Understanding of a Local Gaussian Process Approximation: Characterising Convergence in the Finite Regime

Enhancing Hierarchical Multiscale Off-Road Mobility Model by Neural Network Surrogate Model

A Global-Local Approximation Framework for Large-Scale Gaussian Process Modeling

Learning nonlocal constitutive models with neural networks

Geographically convolutional neural network weighted regression: a method for modeling spatially non-stationary relationships based on a global spatial proximity grid

Local transfer learning Gaussian process modeling, with applications to surrogate modeling of expensive computer simulators

Local Randomized Neural Networks with Discontinuous Galerkin Methods for Partial Differential Equations

Geographically neural network weighted regression for the accurate estimation of spatial non-stationarity

Use of Genetic-Algorithm-optimized Back Propagation Neural Network and Ordinary Kriging for Predicting the Spatial Distribution of Groundwater Quality Parameter

Spatial and Attribute Neural Network Weighted Regression for the Accurate Estimation of Spatial Non-Stationarity

Local Randomized Neural Networks Methods for Interface Problems

Efficient and High-Fidelity Mobility Prediction for Unmanned Ground Vehicles Based on Gaussian Sampled Terrain and Enhanced Neural Network