Abstract:Modeling and inferring spatial relationships and predicting missing values of environmental data are some of the main tasks of geospatial statisticians. These routine tasks are accomplished using multivariate geospatial models and the cokriging technique. The latter requires the evaluation of the expensive Gaussian log-likelihood function, which has impeded the adoption of multivariate geospatial models for large multivariate spatial datasets. However, this large-scale cokriging challenge provides a fertile ground for supercomputing implementations for the geospatial statistics community as it is paramount to scale computational capability to match the growth in environmental data coming from the widespread use of different data collection technologies. In this paper, we develop and deploy large-scale multivariate spatial modeling and inference on parallel hardware architectures. To tackle the increasing complexity in matrix operations and the massive concurrency in parallel systems, we leverage low-rank matrix approximation techniques with task-based programming models and schedule the asynchronous computational tasks using a dynamic runtime system. The proposed framework provides both the dense and the approximated computations of the Gaussian log-likelihood function. It demonstrates accuracy robustness and performance scalability on a variety of computer systems. Using both synthetic and real datasets, the low-rank matrix approximation shows better performance compared to exact computation, while preserving the application requirements in both parameter estimation and prediction accuracy. We also propose a novel algorithm to assess the prediction accuracy after the online parameter estimation. The algorithm quantifies prediction performance and provides a benchmark for measuring the efficiency and accuracy of several approximation techniques in multivariate spatial modeling.

Implementation and analysis of GPU algorithms for Vecchia Approximation

GPU-Accelerated Vecchia Approximations of Gaussian Processes for Geospatial Data using Batched Matrix Computations

Block Vecchia Approximation for Scalable and Efficient Gaussian Process Computations

Iterative Methods for Vecchia-Laplace Approximations for Latent Gaussian Process Models

Vecchia Gaussian Processes: Probabilistic Properties, Minimax Rates and Methodological Developments

Accelerating Geospatial Analysis on GPUs Using CUDA

Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Data

A parallel implementation of nearest neighbor analysis based on GPGPU

Parallel cross-validation: A scalable fitting method for Gaussian process models

Parallelization of the Kriging Algorithm in Stochastic Simulation with GPU Accelerators.

High Performance Multivariate Geospatial Statistics on Manycore Systems

Real-Time Surface Topography Measurement with Graphic Processing Unit

Parallel Inference for Latent Dirichlet Allocation on Graphics Processing Units.

Parallel Gaussian process with kernel approximation in CUDA

Parallel Viewshed Analysis on GPU Using CUDA

A Variational Approach for Modeling High-dimensional Spatial Generalized Linear Mixed Models

Parallel GPU Implementation of Iterative PCA Algorithms

A Vecchia Approximation for High-Dimensional Gaussian Cumulative Distribution Functions Arising from Spatial Data

A Graphics Processing Unit Implementation and Optimization for Parallel Double-Difference Seismic Tomography