Datatractor: Metadata, automation, and registries for extractor interoperability in the chemical and materials sciences

Matthew L. Evans,Gian-Marco Rignanese,David Elbert,Peter Kraus
2024-10-24
Abstract:Two key issues hindering the transition towards FAIR data science are the poor discoverability and inconsistent instructions for the use of data extractor tools, i.e., how we go from raw data files created by instruments, to accessible metadata and scientific insight. If the existing format conversion tools are hard to find, install, and use, their reimplementation will lead to a duplication of effort, and an increase in the associated maintenance burden is inevitable. The Datatractor framework presented in this work addresses these issues. First, by providing a curated registry of such extractor tools their discoverability will increase. Second, by describing them using a standardised but lightweight schema, their installation and use is machine-actionable. Finally, we provide a reference implementation for such data extraction. The Datatractor framework can be used to provide a public-facing data extraction service, or be incorporated into other research data management tools providing added value.
Data Analysis, Statistics and Probability,Materials Science
What problem does this paper attempt to address?