[2-DIMENSIONAL SEPARATION OF PEPTIDES (FINGERPRINT TECHNIC) ON THIN LAYER PLATES].

T. Wieland,D. Georgopoulos

1964-11-06

Abstract:

What problem does this paper attempt to address?

Efficient hybrid density functional calculation by deep learning

Zechen Tang,He Li,Peize Lin,Xiaoxun Gong,Gan Jin,Lixin He,Hong Jiang,Xinguo Ren,Wenhui Duan,Yong Xu

DOI: https://doi.org/10.48550/arxiv.2302.08221

2023-01-01

Abstract: Hybrid density functional calculation is indispensable to accurate description of electronic structure, whereas the formidable computational cost restricts its broad application. Here we develop a deep equivariant neural network method (named DeepH-hybrid) to learn the hybrid-functional Hamiltonian from self-consistent field calculations of small structures, and apply the trained neural networks for efficient electronic-structure calculation by passing the self-consistent iterations. The method is systematically checked to show high efficiency and accuracy, making the study of large-scale materials with hybrid-functional accuracy feasible. As an important application, the DeepH-hybrid method is applied to study large-supercell Moir\'{e} twisted materials, offering the first case study on how the inclusion of exact exchange affects flat bands in the magic-angle twisted bilayer graphene.
Deep-learning density functional theory Hamiltonian for efficient ab initio electronic-structure calculation

He Li,Zun Wang,Nianlong Zou,Meng Ye,Runzhang Xu,Xiaoxun Gong,Wenhui Duan,Yong Xu

DOI: https://doi.org/10.1038/s43588-022-00265-6

2022-06-24

Nature Computational Science

Abstract:The marriage of density functional theory (DFT) and deep-learning methods has the potential to revolutionize modern computational materials science. Here we develop a deep neural network approach to represent the DFT Hamiltonian (DeepH) of crystalline materials, aiming to bypass the computationally demanding self-consistent field iterations of DFT and substantially improve the efficiency of ab initio electronic-structure calculations. A general framework is proposed to deal with the large dimensionality and gauge (or rotation) covariance of the DFT Hamiltonian matrix by virtue of locality, and this is realized by a message-passing neural network for deep learning. High accuracy, high efficiency and good transferability of the DeepH method are generally demonstrated for various kinds of material system and physical property. The method provides a solution to the accuracy–efficiency dilemma of DFT and opens opportunities to explore large-scale material systems, as evidenced by a promising application in the study of twisted van der Waals materials.
Deep learning density functional theory Hamiltonian in real space

Zilong Yuan,Zechen Tang,Honggeng Tao,Xiaoxun Gong,Zezhou Chen,Yuxiang Wang,He Li,Yang Li,Zhiming Xu,Minghui Sun,Boheng Zhao,Chong Wang,Wenhui Duan,Yong Xu

2024-07-19

Abstract:Deep learning electronic structures from ab initio calculations holds great potential to revolutionize computational materials studies. While existing methods proved success in deep-learning density functional theory (DFT) Hamiltonian matrices, they are limited to DFT programs using localized atomic-like bases and heavily depend on the form of the bases. Here, we propose the DeepH-r method for deep-learning DFT Hamiltonians in real space, facilitating the prediction of DFT Hamiltonian in a basis-independent manner. An equivariant neural network architecture for modeling the real-space DFT potential is developed, targeting a more fundamental quantity in DFT. The real-space potential exhibits simplified principles of equivariance and enhanced nearsightedness, further boosting the performance of deep learning. When applied to evaluate the Hamiltonian matrix, this method significantly improved in accuracy, as exemplified in multiple case studies. Given the abundance of data in the real-space potential, this work may pave a novel pathway for establishing a ``large materials model" with increased accuracy.

Computational Physics,Materials Science
DeepH-2: Enhancing deep-learning electronic structure via an equivariant local-coordinate transformer

Yuxiang Wang,He Li,Zechen Tang,Honggeng Tao,Yanzhen Wang,Zilong Yuan,Zezhou Chen,Wenhui Duan,Yong Xu

2024-01-30

Abstract:Deep-learning electronic structure calculations show great potential for revolutionizing the landscape of computational materials research. However, current neural-network architectures are not deemed suitable for widespread general-purpose application. Here we introduce a framework of equivariant local-coordinate transformer, designed to enhance the deep-learning density functional theory Hamiltonian referred to as DeepH-2. Unlike previous models such as DeepH and DeepH-E3, DeepH-2 seamlessly integrates the simplicity of local-coordinate transformations and the mathematical elegance of equivariant neural networks, effectively overcoming their respective disadvantages. Based on our comprehensive experiments, DeepH-2 demonstrates superiority over its predecessors in both efficiency and accuracy, showcasing state-of-the-art performance. This advancement opens up opportunities for exploring universal neural network models or even large materials models.

Computational Physics,Materials Science
General framework for E(3)-equivariant neural network representation of density functional theory Hamiltonian

Xiaoxun Gong,He Li,Nianlong Zou,Runzhang Xu,Wenhui Duan,Yong Xu

DOI: https://doi.org/10.1038/s41467-023-38468-8

IF: 16.6

2023-05-18

Nature Communications

Abstract:Abstract The combination of deep learning and ab initio calculation has shown great promise in revolutionizing future scientific research, but how to design neural network models incorporating a priori knowledge and symmetry requirements is a key challenging subject. Here we propose an E(3)-equivariant deep-learning framework to represent density functional theory (DFT) Hamiltonian as a function of material structure, which can naturally preserve the Euclidean symmetry even in the presence of spin–orbit coupling. Our DeepH-E3 method enables efficient electronic structure calculation at ab initio accuracy by learning from DFT data of small-sized structures, making the routine study of large-scale supercells (>10 4 atoms) feasible. The method can reach sub-meV prediction accuracy at high training efficiency, showing state-of-the-art performance in our experiments. The work is not only of general significance to deep-learning method development but also creates opportunities for materials research, such as building a Moiré-twisted material database.

multidisciplinary sciences
Improving density matrix electronic structure method by deep learning

Zechen Tang,Nianlong Zou,He Li,Yuxiang Wang,Zilong Yuan,Honggeng Tao,Yang Li,Zezhou Chen,Boheng Zhao,Minghui Sun,Hong Jiang,Wenhui Duan,Yong Xu

2024-06-25

Abstract:The combination of deep learning and ab initio materials calculations is emerging as a trending frontier of materials science research, with deep-learning density functional theory (DFT) electronic structure being particularly promising. In this work, we introduce a neural-network method for modeling the DFT density matrix, a fundamental yet previously unexplored quantity in deep-learning electronic structure. Utilizing an advanced neural network framework that leverages the nearsightedness and equivariance properties of the density matrix, the method demonstrates high accuracy and excellent generalizability in multiple example studies, as well as capability to precisely predict charge density and reproduce other electronic structure properties. Given the pivotal role of the density matrix in DFT as well as other computational methods, the current research introduces a novel approach to the deep-learning study of electronic structure properties, opening up new opportunities for deep-learning enhanced computational materials study.

Computational Physics,Materials Science
Deepks: A Comprehensive Data-Driven Approach Toward Chemically Accurate Density Functional Theory

Yixiao Chen,Linfeng Zhang,Han Wang,Weinan E

DOI: https://doi.org/10.1021/acs.jctc.0c00872

2021-01-01

Journal of Chemical Theory and Computation

Abstract:We propose a general machine learning-based framework for building an accurate and widely applicable energy functional within the framework of generalized Kohn-Sham density functional theory. To this end, we develop a way of training self-consistent models that are capable of taking large datasets from different systems and different kinds of labels. We demonstrate that the functional that results from this training procedure gives chemically accurate predictions on energy, force, dipole, and electron density for a large class of molecules. It can be continuously improved when more and more data are available.
Deep Density: Circumventing the Kohn-Sham equations via symmetry preserving neural networks

Leonardo Zepeda-Núñez,Yixiao Chen,Jiefu Zhang,Weile Jia,Linfeng Zhang,Lin Lin

DOI: https://doi.org/10.1016/j.jcp.2021.110523

IF: 4.645

2021-10-01

Journal of Computational Physics

Abstract:<p>The recently developed Deep Potential [Phys. Rev. Lett. 120 (2018) 143001] is a powerful method to represent general inter-atomic potentials using deep neural networks. The success of Deep Potential rests on the proper treatment of locality and symmetry properties of each component of the network. In this paper, we leverage its network structure to effectively represent the mapping from the atomic configuration to the electron density in Kohn-Sham density function theory (KS-DFT). By directly targeting at the self-consistent electron density, we demonstrate that the adapted network architecture, called the Deep Density, can effectively represent the self-consistent electron density as the linear combination of contributions from many local clusters. The network is constructed to satisfy the translation, rotation, and permutation symmetries, and is designed to be transferable to different system sizes. We demonstrate that using a relatively small number of training snapshots, with each snapshot containing a modest amount of data-points, Deep Density achieves excellent performance for one-dimensional insulating and metallic systems, as well as systems with mixed insulating and metallic characters. We also demonstrate its performance for real three-dimensional systems, including small organic molecules, as well as extended systems such as water (up to 512 molecules) and aluminum (up to 256 atoms).</p>

physics, mathematical,computer science, interdisciplinary applications
Deep-learning electronic-structure calculation of magnetic superstructures

He Li,Zechen Tang,Xiaoxun Gong,Nianlong Zou,Wenhui Duan,Yong Xu

DOI: https://doi.org/10.1038/s43588-023-00424-3

2023-04-27

Nature Computational Science

Abstract:Ab initio studies of magnetic superstructures are indispensable to research on emergent quantum materials, but are currently bottlenecked by the formidable computational cost. Here, to break this bottleneck, we have developed a deep equivariant neural network framework to represent the density functional theory Hamiltonian of magnetic materials for efficient electronic-structure calculation. A neural network architecture incorporating a priori knowledge of fundamental physical principles, especially the nearsightedness principle and the equivariance requirements of Euclidean and time-reversal symmetries ( ), is designed, which is critical to capture the subtle magnetic effects. Systematic experiments on spin-spiral, nanotube and moiré magnets were performed, making the challenging study of magnetic skyrmions feasible.
Deep Neural Network Representation of Density Functional Theory Hamiltonian

He Li,Zun Wang,Nianlong Zou,Meng Ye,Wenhui Duan,Yong Xu

2021-01-01

Abstract:The marriage of density functional theory (DFT) and deep learning methods has the potential to revolutionize modern research of material science. Here we study the crucial problem of representing DFT Hamiltonian for crystalline materials of arbitrary configurations via deep neural network. A general framework is proposed to deal with the infinite dimensionality and covariance transformation of DFT Hamiltonian matrix in virtue of locality and use message passing neural network together with graph representation for deep learning. Our example study on graphene-based systems demonstrates that high accuracy ($\sim$meV) and good transferability can be obtained for DFT Hamiltonian, ensuring accurate predictions of materials properties without DFT. The Deep Hamiltonian method provides a solution to the accuracy-efficiency dilemma of DFT and opens new opportunities to explore large-scale materials and physics.
Deep-learning density functional perturbation theory

He Li,Zechen Tang,Jingheng Fu,Wen-Han Dong,Nianlong Zou,Xiaoxun Gong,Wenhui Duan,Yong Xu

DOI: https://doi.org/10.1103/PhysRevLett.132.096401

2024-01-31

Abstract:Calculating perturbation response properties of materials from first principles provides a vital link between theory and experiment, but is bottlenecked by the high computational cost. Here a general framework is proposed to perform density functional perturbation theory (DFPT) calculations by neural networks, greatly improving the computational efficiency. Automatic differentiation is applied on neural networks, facilitating accurate computation of derivatives. High efficiency and good accuracy of the approach are demonstrated by studying electron-phonon coupling and related physical quantities. This work brings deep-learning density functional theory and DFPT into a unified framework, creating opportunities for developing ab initio artificial intelligence.

Computational Physics,Materials Science
Universal Machine Learning Kohn-Sham Hamiltonian for Materials

Yang Zhong,Hongyu Yu,Jihui Yang,Xingyu Guo,Hongjun Xiang,Xingao Gong

2024-04-15

Abstract:While density functional theory (DFT) serves as a prevalent computational approach in electronic structure calculations, its computational demands and scalability limitations persist. Recently, leveraging neural networks to parameterize the Kohn-Sham DFT Hamiltonian has emerged as a promising avenue for accelerating electronic structure computations. Despite advancements, challenges such as the necessity for computing extensive DFT training data to explore each new system and the complexity of establishing accurate ML models for multi-elemental materials still exist. Addressing these hurdles, this study introduces a universal electronic Hamiltonian model trained on Hamiltonian matrices obtained from first-principles DFT calculations of nearly all crystal structures on the Materials Project. We demonstrate its generality in predicting electronic structures across the whole periodic table, including complex multi-elemental systems, solid-state electrolytes, Moiré twisted bilayer heterostructure, and metal-organic frameworks (MOFs). Moreover, we utilize the universal model to conduct high-throughput calculations of electronic structures for crystals in GeNOME datasets, identifying 3,940 crystals with direct band gaps and 5,109 crystals with flat bands. By offering a reliable efficient framework for computing electronic properties, this universal Hamiltonian model lays the groundwork for advancements in diverse fields, such as easily providing a huge data set of electronic structures and also making the materials design across the whole periodic table possible.

Computational Physics,Materials Science,Artificial Intelligence
Accelerating finite-temperature Kohn-Sham density functional theory with deep neural networks

J. A. Ellis,L. Fiedler,G. A. Popoola,N. A. Modine,J. A. Stephens,A. P. Thompson,A. Cangi,S. Rajamanickam

DOI: https://doi.org/10.1103/PhysRevB.104.035120

2021-07-09

Abstract:We present a numerical modeling workflow based on machine learning which reproduces the total energies produced by Kohn-Sham density functional theory (DFT) at finite electronic temperature to within chemical accuracy at negligible computational cost. Based on deep neural networks, our workflow yields the local density of states (LDOS) for a given atomic configuration. From the LDOS, spatially resolved, energy-resolved, and integrated quantities can be calculated, including the DFT total free energy, which serves as the Born-Oppenheimer potential energy surface for the atoms. We demonstrate the efficacy of this approach for both solid and liquid metals and compare results between independent and unified machine-learning models for solid and liquid aluminum. Our machine-learning density functional theory framework opens up the path towards multiscale materials modeling for matter under ambient and extreme conditions at a computational scale and cost that is unattainable with current algorithms. https://doi.org/10.1103/PhysRevB.104.035120 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Published by the American Physical Society

English Else
Machine Learning Electron Density Prediction Using Weighted Smooth Overlap of Atomic Positions

Siddarth K. Achar,Leonardo Bernasconi,J. Karl Johnson

DOI: https://doi.org/10.3390/nano13121853

IF: 5.3

2023-06-13

Nanomaterials

Abstract:Having access to accurate electron densities in chemical systems, especially for dynamical systems involving chemical reactions, ion transport, and other charge transfer processes, is crucial for numerous applications in materials chemistry. Traditional methods for computationally predicting electron density data for such systems include quantum mechanical (QM) techniques, such as density functional theory. However, poor scaling of these QM methods restricts their use to relatively small system sizes and short dynamic time scales. To overcome this limitation, we have developed a deep neural network machine learning formalism, which we call deep charge density prediction (DeepCDP), for predicting charge densities by only using atomic positions for molecules and condensed phase (periodic) systems. Our method uses the weighted smooth overlap of atomic positions to fingerprint environments on a grid-point basis and map it to electron density data generated from QM simulations. We trained models for bulk systems of copper, LiF, and silicon; for a molecular system, water; and for two-dimensional charged and uncharged systems, hydroxyl-functionalized graphane, with and without an added proton. We showed that DeepCDP achieves prediction R2 values greater than 0.99 and mean squared error values on the order of 10−5e2 Å−6 for most systems. DeepCDP scales linearly with system size, is highly parallelizable, and is capable of accurately predicting the excess charge in protonated hydroxyl-functionalized graphane. We demonstrate how DeepCDP can be used to accurately track the location of charges (protons) by computing electron densities at a few selected grid points in the materials, thus significantly reducing the computational cost. We also show that our models can be transferable, allowing prediction of electron densities for systems on which it has not been trained but that contain a subset of atomic species on which it has been trained. Our approach can be used to develop models that span different chemical systems and train them for the study of large-scale charge transport and chemical reactions.

materials science, multidisciplinary,physics, applied,nanoscience & nanotechnology,chemistry
Neural network representation of electronic structure from $ab$ $initio$ molecular dynamics

Qiangqiang Gu,Linfeng Zhang,Ji Feng

DOI: https://doi.org/10.1016/j.scib.2021.09.010

2022-02-21

Abstract:Despite their rich information content, electronic structure data amassed at high volumes in $ab$ $initio$ molecular dynamics simulations are generally under-utilized. We introduce a transferable high-fidelity neural network representation of such data in the form of tight-binding Hamiltonians for crystalline materials. This predictive representation of $ab$ $initio$ electronic structure, combined with machine-learning boosted molecular dynamics, enables efficient and accurate electronic evolution and sampling. When applied to a one-dimension charge-density wave material, carbyne, we are able to compute the spectral function and optical conductivity in the canonical ensemble. The spectral functions evaluated during soliton-antisoliton pair annihilation process reveal significant renormalization of low-energy edge modes due to retarded electron-lattice coupling beyond the Born-Oppenheimer limit. The availability of an efficient and reusable surrogate model for the electronic structure dynamical system will enable calculating many interesting physical properties, paving way to previously inaccessible or challenging avenues in materials modeling.

Materials Science,Disordered Systems and Neural Networks
Universal materials model of deep-learning density functional theory Hamiltonian

Yuxiang Wang,Yang Li,Zechen Tang,He Li,Zilong Yuan,Honggeng Tao,Nianlong Zou,Ting Bao,Xinghao Liang,Zezhou Chen,Shanghua Xu,Ce Bian,Zhiming Xu,Chong Wang,Chen Si,Wenhui Duan,Yong Xu

DOI: https://doi.org/10.1016/j.scib.2024.06.011

2024-06-15

Abstract:Realizing large materials models has emerged as a critical endeavor for materials research in the new era of artificial intelligence, but how to achieve this fantastic and challenging objective remains elusive. Here, we propose a feasible pathway to address this paramount pursuit by developing universal materials models of deep-learning density functional theory Hamiltonian (DeepH), enabling computational modeling of the complicated structure-property relationship of materials in general. By constructing a large materials database and substantially improving the DeepH method, we obtain a universal materials model of DeepH capable of handling diverse elemental compositions and material structures, achieving remarkable accuracy in predicting material properties. We further showcase a promising application of fine-tuning universal materials models for enhancing specific materials models. This work not only demonstrates the concept of DeepH's universal materials model but also lays the groundwork for developing large materials models, opening up significant opportunities for advancing artificial intelligence-driven materials discovery.

Computational Physics,Materials Science

[2-DIMENSIONAL SEPARATION OF PEPTIDES (FINGERPRINT TECHNIC) ON THIN LAYER PLATES].

Efficient hybrid density functional calculation by deep learning

Deep-learning density functional theory Hamiltonian for efficient ab initio electronic-structure calculation

Deep learning density functional theory Hamiltonian in real space

DeepH-2: Enhancing deep-learning electronic structure via an equivariant local-coordinate transformer

General framework for E(3)-equivariant neural network representation of density functional theory Hamiltonian

Improving density matrix electronic structure method by deep learning

Deepks: A Comprehensive Data-Driven Approach Toward Chemically Accurate Density Functional Theory

Deep Density: Circumventing the Kohn-Sham equations via symmetry preserving neural networks

Deep-learning electronic-structure calculation of magnetic superstructures

Deep Neural Network Representation of Density Functional Theory Hamiltonian

Deep-learning density functional perturbation theory

Universal Machine Learning Kohn-Sham Hamiltonian for Materials

Accelerating finite-temperature Kohn-Sham density functional theory with deep neural networks

Machine Learning Electron Density Prediction Using Weighted Smooth Overlap of Atomic Positions

Neural network representation of electronic structure from $ab$ $initio$ molecular dynamics

Universal materials model of deep-learning density functional theory Hamiltonian