How big is Big Data?

Daniel T. Speckhard,Tim Bechtel,Luca M. Ghiringhelli,Martin Kuban,Santiago Rigamonti,Claudia Draxl

2024-05-19

Abstract:Big data has ushered in a new wave of predictive power using machine learning models. In this work, we assess what {\it big} means in the context of typical materials-science machine-learning problems. This concerns not only data volume, but also data quality and veracity as much as infrastructure issues. With selected examples, we ask (i) how models generalize to similar datasets, (ii) how high-quality datasets can be gathered from heterogenous sources, (iii) how the feature set and complexity of a model can affect expressivity, and (iv) what infrastructure requirements are needed to create larger datasets and train models on them. In sum, we find that big data present unique challenges along very different aspects that should serve to motivate further work.

Machine Learning,Materials Science,Computational Physics

What problem does this paper attempt to address?

This paper discusses the meaning and challenges of big data in the field of materials science machine learning. The study focuses on the quantity, quality, and infrastructure issues of data. The authors analyze several points through several examples: (1) how models are generalized to similar datasets; (2) how to collect high-quality data from heterogeneous sources; (3) how feature sets and model complexity affect expressive power; (4) the infrastructure requirements for creating large datasets and training models. They found that big data brings unique problems in materials science, such as different methods having different data requirements, the generalization ability of models not being simple, data quality having a significant impact on results, and the infrastructure requirements for handling and storing big data. In addition, the paper also discusses the impact of data consistency, diversity, and accuracy on the performance of machine learning models.