GrINd: Grid Interpolation Network for Scattered Observations

Andrzej Dulny,Paul Heinisch,Andreas Hotho,Anna Krause
2024-03-29
Abstract:Predicting the evolution of spatiotemporal physical systems from sparse and scattered observational data poses a significant challenge in various scientific domains. Traditional methods rely on dense grid-structured data, limiting their applicability in scenarios with sparse observations. To address this challenge, we introduce GrINd (Grid Interpolation Network for Scattered Observations), a novel network architecture that leverages the high-performance of grid-based models by mapping scattered observations onto a high-resolution grid using a Fourier Interpolation Layer. In the high-resolution space, a NeuralPDE-class model predicts the system's state at future timepoints using differentiable ODE solvers and fully convolutional neural networks parametrizing the system's dynamics. We empirically evaluate GrINd on the DynaBench benchmark dataset, comprising six different physical systems observed at scattered locations, demonstrating its state-of-the-art performance compared to existing models. GrINd offers a promising approach for forecasting physical systems from sparse, scattered observational data, extending the applicability of deep learning methods to real-world scenarios with limited data availability.
Machine Learning
What problem does this paper attempt to address?
The problem addressed by this paper is the challenge of predicting the spatiotemporal evolution of physical systems based on sparse and scattered observational data in various scientific fields such as climate modeling and weather forecasting. Traditional methods rely on dense grid-structured data, which limits their applicability in cases of sparse data. The paper introduces a new network architecture called GrINd (Grid Interpolation Network for Scattered Observations), which maps scattered observational data onto a high-resolution grid using a Fourier interpolation layer. It then uses a combination of a neural PDE class model, a differentiable ODE solver, and a fully convolutional neural network to predict the future state of the system. This approach aims to extend the application of deep learning methods to handle limited data scenarios in the real world and improve the accuracy of predictions for physical systems.