Abstract:Analysis of geospatial data has traditionally been model-based, with a mean model, customarily specified as a linear regression on the covariates, and a Gaussian process covariance model, encoding the spatial dependence. While nonlinear machine learning algorithms like neural networks are increasingly being used for spatial analysis, current approaches depart from the model-based setup and cannot explicitly incorporate spatial covariance. We propose NN-GLS , embedding neural networks directly within the traditional Gaussian process (GP) geostatistical model to accommodate nonlinear mean functions while retaining all other advantages of GP, like explicit modeling of the spatial covariance and predicting at new locations via kriging. In NN-GLS, estimation of the neural network parameters for the nonlinear mean of the Gaussian Process explicitly accounts for the spatial covariance through use of the generalized least squares (GLS) loss, thus, extending the linear case. We show that NN-GLS admits a representation as a special type of graph neural network (GNN). This connection facilitates the use of standard neural network computational techniques for irregular geospatial data, enabling novel and scalable mini-batching, backpropagation, and kriging schemes. We provide methodology to obtain uncertainty bounds for estimation and predictions from NN-GLS. Theoretically, we show that NN-GLS will be consistent for irregularly observed spatially correlated data processes. We also provide a finite sample concentration rate, which quantifies the need to accurately model the spatial covariance in neural networks for dependent data. To our knowledge, these are the first large-sample results for any neural network algorithm for irregular spatial data. We demonstrate the methodology through numerous simulations and an application to air pollution modeling. We develop a software implementation of NN-GLS in the Python package geospaNN. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Neural Entropic Gromov-Wasserstein Alignment

Entropic Gromov-Wasserstein Distances: Stability and Algorithms

Neural Estimation Of Entropic Optimal Transport

Covariance alignment: from maximum likelihood estimation to Gromov-Wasserstein

Limit Laws for Gromov-Wasserstein Alignment with Applications to Testing Graph Isomorphisms

Outlier-Robust Gromov-Wasserstein for Graph Data

GeONet: a neural operator for learning the Wasserstein geodesic

Entropic Optimal Transport Eigenmaps for Nonlinear Alignment and Joint Embedding of High-Dimensional Datasets

On Robust Cross Domain Alignment

Linear Partial Gromov-Wasserstein Embedding

Hierarchical Optimal Transport for Multimodal Distribution Alignment

Strongly Isomorphic Neural Optimal Transport Across Incomparable Spaces

Improving Hyperbolic Representations via Gromov-Wasserstein Regularization

Efficient Approximation of Gromov-Wasserstein Distance Using Importance Sparsification

Scalable unsupervised alignment of general metric and non-metric structures

Computing the Gromov-Wasserstein Distance between Two Surface Meshes Using Optimal Transport

Learning High Dimensional Wasserstein Geodesics

Entropic Neural Optimal Transport via Diffusion Processes

Revisiting invariances and introducing priors in Gromov-Wasserstein distances

Aligning Embeddings and Geometric Random Graphs: Informational Results and Computational Approaches for the Procrustes-Wasserstein Problem

Neural Networks for Geospatial Data