M^2M: Learning Controllable Multi of Experts and Multi-Scale Operators Are the Partial Differential Equations Need

Aoming Liang,Zhaoyang Mu,Pengxiao Lin,Cong Wang,Mingming Ge,Ling Shao,Dixia Fan,Hao Tang
2024-01-01
Abstract:Learning the evolutionary dynamics of Partial Differential Equations (PDEs) is critical in understanding dynamic systems, yet current methods insufficiently learn their representations. This is largely due to the multi-scale nature of the solution, where certain regions exhibit rapid oscillations while others evolve more slowly. This paper introduces a framework of multi-scale and multi-expert (M^2M) neural operators designed to simulate and learn PDEs efficiently. We employ a divide-and-conquer strategy to train a multi-expert gated network for the dynamic router policy. Our method incorporates a controllable prior gating mechanism that determines the selection rights of experts, enhancing the model's efficiency. To optimize the learning process, we have implemented a PI (Proportional, Integral) control strategy to adjust the allocation rules precisely. This universal controllable approach allows the model to achieve greater accuracy. We test our approach on benchmark 2D Navier-Stokes equations and provide a custom multi-scale dataset. M^2M can achieve higher simulation accuracy and offer improved interpretability compared to baseline methods.
What problem does this paper attempt to address?