Abstract:Machine learning methods are being increasingly used in condensed matter physics and materials science to classify crystals structures and predict material properties. However, the reliability of these methods for a given problem, especially when large data sets are unavailable, has not been well studied. By addressing the tasks of classifying crystal structure and predicting melting temperatures of the octet subset of AB solids, we performed such a study and found potential problems with using machine learning methods on relatively small data sets. At the same time, however, we can reaffirm the potential power of such methods for these tasks. In particular, we uncovered an important new material feature, the excess Born effective charge, that significantly increased the accuracy of the predictions for the classification problem we defined. This discovery leads us to propose a new scale for the degree of ionicity and covalency in these solids. More specifically, we partitioned the crystal structures of a set of 75 octet solids into those that are ionic and covalent bonded and thus performed a binary classification task. We found that using the standard indices (rσ,rπ), suggested by St. John and Bloch several decades ago, enabled an average success in classification of 92%. Using just rσ and the excess Born effective charge ΔZA of the A atom enabled an average success of 97%, but we also found relatively large variations about these averages that were dependent on how certain machine learning methods were used and for which a standard deviation was not a proper measure of the degree of confidence we can place in either average. Instead, we calculated and report with 95% confidence that the traditional classification pair predicts an accuracy in the interval [89%,95%] and the accuracy of the new pair lies in the interval [96%,99%]. For melting temperature predictions, the size of our data set was 46. We estimate the root-mean-squared error of our resulting model to be 11% of the mean melting temperature of the data, but we note that if the accuracy of this predicted error is itself measured, our estimated fitting error itself has a root-mean-square error of 50%. In short, what we illustrate is that classification and regression predictions can vary significantly, depending on the details of how machine learning methods are applied to small data sets. This variation makes it important, if not essential, to average the predictions and compute confidence intervals about these averages to report results meaningfully. However, when properly used, these statistical methods can advance our understanding and improve predictions of material properties even for small data sets.

Towards machine learning for microscopic mechanisms: a formula search for crystal structure stability based on atomic properties

Machine learning for the structure-energy-property landscapes of molecular crystals

A Hybrid Machine Learning Approach for Structure Stability Prediction in Molecular Co-crystal Screenings

Accelerating the prediction of stable materials with machine learning

Materials discovery through machine learning formation energy

Large-scale machine-learning-assisted exploration of the whole materials space

Machine Learning of Molecular Electronic Properties in Chemical Compound Space

Crystal structure prediction with machine learning-based element substitution

Machine learning approaches for feature engineering of the crystal structure: Application to the prediction of the formation energy of cubic compounds

A critical examination of compound stability predictions from machine-learned formation energies

Machine-learning correction to density-functional crystal structure optimization

Putting Density Functional Theory to the Test in Machine-Learning-Accelerated Materials Discovery

Structure classification and melting temperature prediction in octet AB solids via machine learning

Learning Atoms from Crystal Structure

Machine learning bridges local static structure with multiple properties in metallic glasses

Roadmap on Machine Learning in Electronic Structure

Artificial intelligence real-time prediction and physical interpretation of atomic binding energies in nano-scale metal clusters

Long-range dispersion-inclusive machine learning potentials for structure search and optimization of hybrid organic-inorganic interfaces

Machine learning accelerates quantum mechanics predictions of molecular crystals

Prediction and Classification of Formation Energies of Binary Compounds by Machine Learning: An Approach without Crystal Structure Information