Abstract:Modeling and inferring spatial relationships and predicting missing values of environmental data are some of the main tasks of geospatial statisticians. These routine tasks are accomplished using multivariate geospatial models and the cokriging technique. The latter requires the evaluation of the expensive Gaussian log-likelihood function, which has impeded the adoption of multivariate geospatial models for large multivariate spatial datasets. However, this large-scale cokriging challenge provides a fertile ground for supercomputing implementations for the geospatial statistics community as it is paramount to scale computational capability to match the growth in environmental data coming from the widespread use of different data collection technologies. In this paper, we develop and deploy large-scale multivariate spatial modeling and inference on parallel hardware architectures. To tackle the increasing complexity in matrix operations and the massive concurrency in parallel systems, we leverage low-rank matrix approximation techniques with task-based programming models and schedule the asynchronous computational tasks using a dynamic runtime system. The proposed framework provides both the dense and the approximated computations of the Gaussian log-likelihood function. It demonstrates accuracy robustness and performance scalability on a variety of computer systems. Using both synthetic and real datasets, the low-rank matrix approximation shows better performance compared to exact computation, while preserving the application requirements in both parameter estimation and prediction accuracy. We also propose a novel algorithm to assess the prediction accuracy after the online parameter estimation. The algorithm quantifies prediction performance and provides a benchmark for measuring the efficiency and accuracy of several approximation techniques in multivariate spatial modeling.

A Divide-and-Conquer Bayesian Approach to Large-Scale Kriging

Kryging: Geostatistical analysis of large-scale datasets using Krylov subspace methods

High-Dimensional Bayesian Geostatistics

A Scalable Partitioned Approach to Model Massive Nonstationary Non-Gaussian Spatial Datasets

Sparse Pseudo-input Local Kriging for Large Spatial Datasets with Exogenous Variables

High Performance Multivariate Geospatial Statistics on Manycore Systems

Adaptive Bayesian nonstationary modeling for large spatial datasets using covariance approximations

A Statistical Learning View of Simple Kriging

Highly Scalable Bayesian Geostatistical Modeling via Meshed Gaussian Processes on Partitioned Domains

Grid-Parametrize-Split (GriPS) for Improved Scalable Inference in Spatial Big Data Analysis

Bayesian inference for high-dimensional nonstationary Gaussian processes

Bayesian Nonstationary Spatial Modeling for Very Large Datasets

Indexing and Partitioning the Spatial Linear Model for Large Data Sets

Exploring the Efficacy of Statistical and Deep Learning Methods for Large Spatial Datasets: A Case Study

Reduced Basis Kriging for Big Spatial Fields

Incorporating Subsampling into Bayesian Models for High-Dimensional Spatial Data

Flexible Basis Representations for Modeling Large Non-Gaussian Spatial Data

Improving the performance of predictive process modeling for large datasets

An adaptive kriging method for solving nonlinear inverse statistical problems

Normalizing Basis Functions: Approximate Stationary Models for Large Spatial Data