Abstract:Material scientists are increasingly adopting the use of machine learning (ML) for making potentially important decisions, such as, discovery, development, optimization, synthesis and characterization of materials. However, despite ML's impressive performance in commercial applications, several unique challenges exist when applying ML in materials science applications. In such a context, the contributions of this work are twofold. First, we identify common pitfalls of existing ML techniques when learning from underrepresented/imbalanced material data. Specifically, we show that with imbalanced data, standard methods for assessing quality of ML models break down and lead to misleading conclusions. Furthermore, we found that the model's own confidence score cannot be trusted and model introspection methods (using simpler models) do not help as they result in loss of predictive performance (reliability-explainability trade-off). Second, to overcome these challenges, we propose a general-purpose explainable and reliable machine-learning framework. Specifically, we propose a novel pipeline that employs an ensemble of simpler models to reliably predict material properties. We also propose a transfer learning technique and show that the performance loss due to models' simplicity can be overcome by exploiting correlations among different material properties. A new evaluation metric and a trust score to better quantify the confidence in the predictions are also proposed. To improve the interpretability, we add a rationale generator component to our framework which provides both model-level and decision-level explanations. Finally, we demonstrate the versatility of our technique on two applications: 1) predicting properties of crystalline compounds, and 2) identifying novel potentially stable solar cell materials.

Distance-based Analysis of Machine Learning Prediction Reliability for Datasets in Materials Science and Other Fields

Analysis of Machine Learning Prediction Reliability based on Sampling Distance Evaluation with Feature Decorrelation

Identification of high-reliability regions of machine learning predictions in materials science using transparent conducting oxides and perovskites as examples

A strategy to apply machine learning to small datasets in materials science

A critical examination of robustness and generalizability of machine learning prediction of materials properties

Reliable and Explainable Machine Learning Methods for Accelerated Material Discovery

Quantifying the performance of machine learning models in materials discovery

Machine Learning Materials Properties with Accurate Predictions, Uncertainty Estimates, Domain Guidance, and Persistent Online Accessibility

Applications of machine learning method in high-performance materials design: a review

Reflections on the future of machine learning for materials research

Application of machine learning for advanced material prediction and design

Determining Domain of Machine Learning Models using Kernel Density Estimates: Applications in Materials Property Prediction

Evaluating generalized feature importance via performance assessment of machine learning models for predicting elastic properties of materials

Data-Driven Materials Discovery and Synthesis using Machine Learning Methods

Probing out-of-distribution generalization in machine learning for materials

Recent progress on machine learning with limited materials data: Using tools from data science and domain knowledge

Uncertainty Prediction for Machine Learning Models of Material Properties

From prediction to design: Recent advances in machine learning for the study of 2D materials

Prediction Confidence from Neighbors

A Metric-Learning-Based Nonlinear Modeling Algorithm and Its Application in Key-Performance-Indicator Prediction

Prediction of material stability of two-dimensional semiconductors: An interpretable machine learning perspective