Abstract:Implicit Neural Spatial Representation (INSR) has emerged as an effective representation of spatially-dependent vector fields. This work explores solving time-dependent PDEs with INSR. Classical PDE solvers introduce both temporal and spatial discretizations. Common spatial discretizations include meshes and meshless point clouds, where each degree-of-freedom corresponds to a location in space. While these explicit spatial correspondences are intuitive to model and understand, these representations are not necessarily optimal for accuracy, memory usage, or adaptivity. Keeping the classical temporal discretization unchanged (e.g., explicit/implicit Euler), we explore INSR as an alternative spatial discretization, where spatial information is implicitly stored in the neural network weights. The network weights then evolve over time via time integration. Our approach does not require any training data generated by existing solvers because our approach is the solver itself. We validate our approach on various PDEs with examples involving large elastic deformations, turbulent fluids, and multi-scale phenomena. While slower to compute than traditional representations, our approach exhibits higher accuracy and lower memory consumption. Whereas classical solvers can dynamically adapt their spatial representation only by resorting to complex remeshing algorithms, our INSR approach is intrinsically adaptive. By tapping into the rich literature of classic time integrators, e.g., operator-splitting schemes, our method enables challenging simulations in contact mechanics and turbulent flows where previous neural-physics approaches struggle. Videos and codes are available on the project page: <a class="link-external link-http" href="http://www.cs.columbia.edu/cg/INSR-PDE/" rel="external noopener nofollow">this http URL</a>

Space-Time Continuous PDE Forecasting using Equivariant Neural Fields

STONet: A Neural-Operator-Driven Spatio-temporal Network

Non-equispaced Fourier Neural Solvers for PDEs

Grounding Continuous Representations in Geometry: Equivariant Neural Fields

Vectorized Conditional Neural Fields: A Framework for Solving Time-dependent Parametric Partial Differential Equations

Learning Space-Time Continuous Neural PDEs from Partially Observed States

Space and Time Continuous Physics Simulation From Partial Observations

Physics-embedded Fourier Neural Network for Partial Differential Equations

Diffeomorphic Latent Neural Operators for Data-Efficient Learning of Solutions to Partial Differential Equations

Latent Neural PDE Solver: a reduced-order modelling framework for partial differential equations

NeuralPDE: Modelling Dynamical Systems from Data

Neural SPDE solver for uncertainty quantification in high-dimensional space-time dynamics

GEPS: Boosting Generalization in Parametric PDE Neural Solvers through Adaptive Conditioning

Equivariant Neural Simulators for Stochastic Spatiotemporal Dynamics

Scalable Spatiotemporal Prediction with Bayesian Neural Fields

Fourier Neural Operator with Learned Deformations for PDEs on General Geometries

Neural-PDE: a RNN Based Neural Network for Solving Time Dependent PDEs

Multiple Wavefield Solutions in Physics-Informed Neural Networks Using Latent Representation

A Continuous Encoder-Decoder Method for Spatial-Temporal Forecasting

Implicit Neural Spatial Representations for Time-dependent PDEs

Enhanced Spatiotemporal Prediction Using Physical-guided And Frequency-enhanced Recurrent Neural Networks