Adapting OC20-trained EquiformerV2 Models for High-Entropy Materials

Christian M. Clausen,Jan Rossmeisl,Zachary W. Ulissi
2024-03-15
Abstract:Computational high-throughput studies, especially in research on high-entropy materials and catalysts, are hampered by high-dimensional composition spaces and myriad structural microstates. They present bottlenecks to the conventional use of density functional theory calculations, and consequently, the use of machine-learned potentials is becoming increasingly prevalent in atomic structure simulations. In this communication, we show the results of adjusting and fine-tuning the pretrained EquiformerV2 model from the Open Catalyst Project to infer adsorption energies of *OH and *O on the out-of-domain high-entropy alloy Ag-Ir-Pd-Pt-Ru. By applying an energy filter based on the local environment of the binding site the zero-shot inference is markedly improved and through few-shot fine-tuning the model yields state-of-the-art accuracy. It is also found that EquiformerV2, assuming the role of general machine learning potential, is able to inform a smaller, more focused direct inference model. This knowledge distillation setup boosts performance on complex binding sites. Collectively, this shows that foundational knowledge learned from ordered intermetallic structures, can be extrapolated to the highly disordered structures of solid-solutions. With the vastly accelerated computational throughput of these models, hitherto infeasible research in the high-entropy material space is now readily accessible.
Materials Science,Machine Learning,Chemical Physics
What problem does this paper attempt to address?
This paper addresses the computational challenges in the study of High Entropy Materials (HEMs), particularly the density functional theory (DFT) calculations bottleneck caused by high-dimensional composition space and a large number of structural microstates. The paper proposes a method that adjusts and fine-tunes the pre-trained EquiformerV2 model to predict the adsorption energy of *OH and *O on the surface of HEAs. By applying an energy filter based on the local environment of adsorption sites, the prediction accuracy of the model can be significantly improved. In addition, through knowledge distillation, using EquiformerV2 as the base model to train a more focused direct prediction model, the prediction speed and accuracy are improved. This approach enables high-throughput computing in the field of high entropy materials and accelerates the research of new catalyst materials.