Efficient prediction of potential energy surface and physical properties with Kolmogorov-Arnold Networks

Rui Wang,Hongyu Yu,Yang Zhong,Hongjun Xiang
2024-09-05
Abstract:The application of machine learning methodologies for predicting properties within materials science has garnered significant attention. Among recent advancements, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to traditional Multi-Layer Perceptrons (MLPs). This study evaluates the impact of substituting MLPs with KANs within three established machine learning frameworks: Allegro, Neural Equivariant Interatomic Potentials (NequIP), and the Edge-Based Tensor Prediction Graph Neural Network (ETGNN). Our results demonstrate that the integration of KANs generally yields enhanced prediction accuracies. Specifically, replacing MLPs with KANs in the output blocks leads to notable improvements in accuracy and, in certain scenarios, also results in reduced training times. Furthermore, employing KANs exclusively in the output block facilitates faster inference and improved computational efficiency relative to utilizing KANs throughout the entire model. The selection of an optimal basis function for KANs is found to be contingent upon the particular problem at hand. Our results demonstrate the strong potential of KANs in enhancing machine learning potentials and material property predictions.
Computational Physics,Materials Science
What problem does this paper attempt to address?
The main objective of this paper is to evaluate the effectiveness of using Kolmogorov-Arnold Networks (KANs) as a replacement for traditional Multi-Layer Perceptrons (MLPs) in material property prediction. Specifically, the researchers replaced MLPs in three existing machine learning frameworks (Allegro, Neural Equivariant Interatomic Potentials (NequIP), and Edge-Based Tensor Prediction Graph Neural Network (ETGNN)) and conducted experiments with KANs. The results indicate that replacing MLPs in the output block can significantly improve prediction accuracy and, in some cases, reduce training time. Moreover, using KANs only in the output block, as opposed to the entire model, can lead to faster inference speed and higher computational efficiency. The optimal basis function depends on the specific problem. The findings demonstrate the great potential of KANs in enhancing machine learning models for material property prediction.