Abstract:This paper proposes a novel neural network architecture and its ensembles to predict the critical superconductivity temperature of materials based on their chemical formula. The research describes the methods and processes of extracting data from the chemical formula and preparing these extracted data for use in neural network training using TensorFlow. In our approach, recurrent neural networks are used including long short-term memory layers and neural networks based on one-dimensional convolution layers for data analysis. The proposed model is an ensemble of pre-trained neural network architectures for the prediction of the critical temperature of superconductors based on their chemical formula. The architecture of seven pre-trained neural networks is based on the long short-term memory layers and convolution layers. In the final ensemble, six neural networks are used: one network based on LSTM and four based on convolutional neural networks, and one embedding ensemble of convolution neural networks. LSTM neural network and convolution neural network were trained in 300 epochs. Ensembles of models were trained in 20 epochs. All neural networks are trained in two stages. At both stages, the optimizer Adam was used. In the first stage, training was carried out by the function of losses Mean Absolute Error (MAE) with the value of optimizer learning rate equal to 0.001. In the second stage, the previously trained model was trained by the function of losses Mean Squared Error (MSE) with a learning rate equal to 0.0001. The final ensemble is trained with a learning rate equal to 0.00001. The final ensemble model has the following accuracy values: MAE is 4.068, MSE is 67.272, and the coefficient of determination (R2) is 0.923. The final model can predict the critical temperature for the chemistry formula with an accuracy of 4.068°.

Crystal Structure Graph Neural Networks for High-Performance Superconducting Critical Temperature Prediction

Searching High Temperature Superconductors with the assistance of Graph Neural Networks

Role of the stem cell factor (SCF) receptor and the alternative forms of its ligand (SCF) in the induction of long-term growth by stroma cells.

Critical Temperature Prediction of Superconductors Based on Atomic Vectors and Deep Learning

Enhancing Superconductor Critical Temperature Prediction: A Novel Machine Learning Approach Integrating Dopant Recognition

High-Tc superconductor candidates proposed by machine learning

Enhancing crystal structure prediction by combining computational and experimental data via graph networks

Graph Neural Networks for an Accurate and Interpretable Prediction of the Properties of Polycrystalline Materials

Deep Learning Approach for Prediction of Critical Temperature of Superconductor Materials Described by Chemical Formulas

Predicting melting temperature of inorganic crystals via crystal graph neural network enhanced by transfer learning

CTGNN: Crystal Transformer Graph Neural Network for Crystal Material Property Prediction

Atom table convolutional neural networks for an accurate prediction of compounds properties

Study of crystal properties based on attention mechanism and crystal graph convolutional neural network

General Graph Neural Network-Based Model To Accurately Predict Cocrystal Density and Insight from Data Quality and Feature Representation

Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties

Topological representations of crystalline compounds for the machine-learning prediction of materials properties

Machine-Learning-Guided Prediction Models of Critical Temperature of Cuprates

Novel machine learning framework for thermal conductivity prediction by crystal graph convolution embedded ensemble

Predicting lattice thermal conductivity of semiconductors from atomic-information-enhanced CGCNN combined with transfer learning

Crystal structure prediction by combining graph network and optimization algorithm

Interpretably learning the critical temperature of superconductors: Electron concentration and feature dimensionality reduction