S2SNet: A Pretrained Neural Network for Superconductivity Discovery

Ke Liu,Kaifan Yang,Jiahong Zhang,Renjun Xu
2023-06-28
Abstract:Superconductivity allows electrical current to flow without any energy loss, and thus making solids superconducting is a grand goal of physics, material science, and electrical engineering. More than 16 Nobel Laureates have been awarded for their contribution to superconductivity research. Superconductors are valuable for sustainable development goals (SDGs), such as climate change mitigation, affordable and clean energy, industry, innovation and infrastructure, and so on. However, a unified physics theory explaining all superconductivity mechanism is still unknown. It is believed that superconductivity is microscopically due to not only molecular compositions but also the geometric crystal structure. Hence a new dataset, S2S, containing both crystal structures and superconducting critical temperature, is built upon SuperCon and Material Project. Based on this new dataset, we propose a novel model, S2SNet, which utilizes the attention mechanism for superconductivity prediction. To overcome the shortage of data, S2SNet is pre-trained on the whole Material Project dataset with Masked-Language Modeling (MLM). S2SNet makes a new state-of-the-art, with out-of-sample accuracy of 92% and Area Under Curve (AUC) of 0.92. To the best of our knowledge, S2SNet is the first work to predict superconductivity with only information of crystal structures. This work is beneficial to superconductivity discovery and further SDGs. Code and datasets are available in <a class="link-external link-https" href="https://github.com/zjuKeLiu/S2SNet" rel="external noopener nofollow">this https URL</a>
Superconductivity,Machine Learning
What problem does this paper attempt to address?
The paper attempts to address the problem of predicting the superconductivity of materials using only crystal structure information. Specifically, the authors propose a new dataset, S2S, which includes crystal structures and superconducting critical temperatures. Based on this dataset, they developed a new pre-trained neural network model, S2SNet. This model utilizes an attention mechanism to predict the superconductivity of materials and is pre-trained using the Masked-Language Modeling (MLM) task to overcome the issue of insufficient data. To the best of the authors' knowledge, this is the first research work that can predict the superconductivity of materials using only crystal structure information. This achievement is of great significance for the discovery of superconducting materials and the goals of sustainable development.