MassSpecGym: A benchmark for the discovery and identification of molecules

Roman Bushuiev,Anton Bushuiev,Niek F. de Jonge,Adamo Young,Fleming Kretschmer,Raman Samusevich,Janne Heirman,Fei Wang,Luke Zhang,Kai Dührkop,Marcus Ludwig,Nils A. Haupt,Apurva Kalia,Corinna Brungs,Robin Schmid,Russell Greiner,Bo Wang,David S. Wishart,Li-Ping Liu,Juho Rousu,Wout Bittremieux,Hannes Rost,Tytus D. Mak,Soha Hassoun,Florian Huber,Justin J.J. van der Hooft,Michael A. Stravs,Sebastian Böcker,Josef Sivic,Tomáš Pluskal

2024-10-30

Abstract:The discovery and identification of molecules in biological and environmental samples is crucial for advancing biomedical and chemical sciences. Tandem mass spectrometry (MS/MS) is the leading technique for high-throughput elucidation of molecular structures. However, decoding a molecular structure from its mass spectrum is exceptionally challenging, even when performed by human experts. As a result, the vast majority of acquired MS/MS spectra remain uninterpreted, thereby limiting our understanding of the underlying (bio)chemical processes. Despite decades of progress in machine learning applications for predicting molecular structures from MS/MS spectra, the development of new methods is severely hindered by the lack of standard datasets and evaluation protocols. To address this problem, we propose MassSpecGym -- the first comprehensive benchmark for the discovery and identification of molecules from MS/MS data. Our benchmark comprises the largest publicly available collection of high-quality labeled MS/MS spectra and defines three MS/MS annotation challenges: \textit{de novo} molecular structure generation, molecule retrieval, and spectrum simulation. It includes new evaluation metrics and a generalization-demanding data split, therefore standardizing the MS/MS annotation tasks and rendering the problem accessible to the broad machine learning community. MassSpecGym is publicly available at \url{<a class="link-external link-https" href="https://github.com/pluskal-lab/MassSpecGym" rel="external noopener nofollow">this https URL</a>}.

Quantitative Methods,Machine Learning

What problem does this paper attempt to address?

The paper attempts to address the challenges of discovering and identifying molecules in biological and environmental samples. Specifically, tandem mass spectrometry (MS/MS) is the primary technique for high-throughput molecular structure analysis, but decoding molecular structures from it is very difficult, even for human experts. As a result, most acquired MS/MS spectra remain uninterpreted, limiting the understanding of potential (bio)chemical processes.

Despite decades of progress in applying machine learning to predict molecular structures from MS/MS spectra, the development of new methods has been severely hindered by the lack of standard datasets and evaluation protocols. To address this issue, the authors propose MassSpecGym—the first comprehensive benchmark for discovering and identifying molecules from MS/MS data. This benchmark includes the largest publicly available collection of high-quality annotated MS/MS spectra and defines three MS/MS annotation challenges: de novo molecular structure generation, molecular retrieval, and spectrum simulation. It also introduces new evaluation metrics and data splitting methods with generalization requirements, thereby standardizing MS/MS annotation tasks and making the problem accessible to the broader machine learning community.