Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systems

Xuan Zhang,Limei Wang,Jacob Helwig,Youzhi Luo,Cong Fu,Yaochen Xie,Meng Liu,Yuchao Lin,Zhao Xu,Keqiang Yan,Keir Adams,Maurice Weiler,Xiner Li,Tianfan Fu,Yucheng Wang,Haiyang Yu,YuQing Xie,Xiang Fu,Alex Strasser,Shenglong Xu,Yi Liu,Yuanqi Du,Alexandra Saxton,Hongyi Ling,Hannah Lawrence,Hannes Stärk,Shurui Gui,Carl Edwards,Nicholas Gao,Adriana Ladera,Tailin Wu,Elyssa F. Hofgard,Aria Mansouri Tehrani,Rui Wang,Ameya Daigavane,Montgomery Bohde,Jerry Kurtin,Qian Huang,Tuong Phung,Minkai Xu,Chaitanya K. Joshi,Simon V. Mathis,Kamyar Azizzadenesheli,Ada Fang,Alán Aspuru-Guzik,Erik Bekkers,Michael Bronstein,Marinka Zitnik,Anima Anandkumar,Stefano Ermon,Pietro Liò,Rose Yu,Stephan Günnemann,Jure Leskovec,Heng Ji,Jimeng Sun,Regina Barzilay,Tommi Jaakkola,Connor W. Coley,Xiaoning Qian,Xiaofeng Qian,Tess Smidt,Shuiwang Ji

2024-10-13

Abstract:Advances in artificial intelligence (AI) are fueling a new paradigm of discoveries in natural sciences. Today, AI has started to advance natural sciences by improving, accelerating, and enabling our understanding of natural phenomena at a wide range of spatial and temporal scales, giving rise to a new area of research known as AI for science (AI4Science). Being an emerging research paradigm, AI4Science is unique in that it is an enormous and highly interdisciplinary area. Thus, a unified and technical treatment of this field is needed yet challenging. This work aims to provide a technically thorough account of a subarea of AI4Science; namely, AI for quantum, atomistic, and continuum systems. These areas aim at understanding the physical world from the subatomic (wavefunctions and electron density), atomic (molecules, proteins, materials, and interactions), to macro (fluids, climate, and subsurface) scales and form an important subarea of AI4Science. A unique advantage of focusing on these areas is that they largely share a common set of challenges, thereby allowing a unified and foundational treatment. A key common challenge is how to capture physics first principles, especially symmetries, in natural systems by deep learning methods. We provide an in-depth yet intuitive account of techniques to achieve equivariance to symmetry transformations. We also discuss other common technical challenges, including explainability, out-of-distribution generalization, knowledge transfer with foundation and large language models, and uncertainty quantification. To facilitate learning and education, we provide categorized lists of resources that we found to be useful. We strive to be thorough and unified and hope this initial effort may trigger more community interests and efforts to further advance AI4Science.

Machine Learning,Computational Physics

What problem does this paper attempt to address?

The paper attempts to address the application of Artificial Intelligence (AI) in accelerating natural science research across quantum, atomic, and continuum systems. Specifically, the paper focuses on the following aspects:

1. **Multiscale Modeling of the Physical World**:
- Understanding the multilevel phenomena of the physical world from subatomic scales (wave functions and electron density), atomic scales (molecules, proteins, materials, and their interactions) to macroscopic scales (fluids, climate, and subsurface systems).

2. **Unified Technical Approach**:
- The common challenge in these fields is how to capture the physical first principles of natural systems through deep learning methods, especially symmetry. The paper provides an in-depth and intuitive technical introduction to achieving symmetry transformation invariance and discusses other common technical challenges such as interpretability, out-of-distribution generalization, knowledge transfer and the combination of foundational models and large-scale language models, uncertainty quantification, etc.

3. **Technical Advances in Specific Research Areas**:
- **Quantum Mechanics**: Designing efficient neural wave function learning methods.
- **Density Functional Theory (DFT)**: Developing methods to accurately predict quantum tensors, thereby deriving various physical and chemical properties of molecules and solids.
- **Small Molecules**: Accelerating the characterization, generation, simulation, and dynamics study of small molecules at the atomic level.
- **Protein Science**: Learning representations of protein 3D structures and generating and designing novel proteins.
- **Materials Science**: Predicting the properties of crystalline materials and designing new crystal structures.
- **Molecular Interactions**: Modeling various molecular interactions, such as ligand-receptor and molecule-material interactions.
- **Continuum Mechanics**: Using partial differential equations (PDE) to model macroscopic physical processes such as fluid flow, heat transfer, and electromagnetic waves.

4. **Education and Resources**:
- Compiling useful resource lists to promote learning and education, exploring how to better integrate AI with science and education.

Through a comprehensive analysis of these aspects, the paper aims to provide a thorough and unified technical overview of the application of AI in science, promoting further development in this interdisciplinary field.