Blending neural operators and relaxation methods in PDE numerical solvers
Enrui Zhang,Adar Kahana,Alena Kopaničáková,Eli Turkel,Rishikesh Ranade,Jay Pathak,George Em Karniadakis
DOI: https://doi.org/10.1038/s42256-024-00910-x
IF: 23.8
2024-10-18
Nature Machine Intelligence
Abstract:Neural networks suffer from spectral bias and have difficulty representing the high-frequency components of a function, whereas relaxation methods can resolve high frequencies efficiently but stall at moderate to low frequencies. We exploit the weaknesses of the two approaches by combining them synergistically to develop a fast numerical solver of partial differential equations (PDEs) at scale. Specifically, we propose HINTS, a hybrid, iterative, numerical and transferable solver by integrating a Deep Operator Network (DeepONet) with standard relaxation methods, leading to parallel efficiency and algorithmic scalability for a wide class of PDEs, not tractable with existing monolithic solvers. HINTS balances the convergence behaviour across the spectrum of eigenmodes by utilizing the spectral bias of DeepONet, resulting in a uniform convergence rate and hence exceptional performance of the hybrid solver overall. Moreover, HINTS applies to large-scale, multidimensional systems; it is flexible with regards to discretizations, computational domain and boundary conditions; and it can also be used to precondition Krylov methods.
computer science, artificial intelligence, interdisciplinary applications