Abstract:Weakly labeled data are common in mass spectrometry imaging (MSI). Such data contain labels at the image‐level, but not at the pixel level. Despite being ubiquitous, minimal attention is given to developing machine learning methods targeted toward such data. This work describes a multiple‐instance learning methodology for handling weakly labeled MSI data sets, with promising results. Supervised and unsupervised machine learning algorithms are routinely applied to time‐of‐flight secondary ion mass spectrometry (ToF‐SIMS) imaging data and, more broadly, to mass spectrometry imaging (MSI). These algorithms have accelerated large‐scale, single‐pixel analysis, classification, and regression. However, there is relatively little research on methods suited for so‐called weakly supervised problems, where ground‐truth class labels exist at the image level, but not at the individual pixel level. Unsupervised learning methods are usually applied to these problems. However, these methods cannot make use of available labels. Here a novel method specifically designed for weakly supervised MSI data is presented. A dual‐stream multiple instance learning (MIL) approach is adapted from computational pathology that reveals the spatial‐spectral characteristics distinguishing different classes of MSI images. The method uses an information entropy‐regularized attention mechanism to identify characteristic class pixels that are then used to extract characteristic mass spectra. This work provides a proof‐of‐concept exemplification using printed ink samples imaged by ToF‐SIMS. A second application‐oriented study is also presented, focusing on the analysis of a mixed powder sample type. Results demonstrate the potential of the MIL method for broader application in MSI, with implications for understanding subtle spatial‐spectral characteristics in various applications and contexts.

Markedly Enhanced Analysis of Mass Spectrometry Images Using Weakly Supervised Machine Learning

Enhancing Classification of Mass Spectrometry Imaging Data with Deep Neural Networks.

Leveraging Supervised Machine Learning Algorithms for System Suitability Testing of Mass Spectrometry Imaging Platforms

Peak learning of mass spectrometry imaging data using artificial neural networks

Unsupervised machine learning for exploratory data analysis in imaging mass spectrometry

[Research progress of deep learning applications in mass spectrometry imaging data analysis]

Deep multiple instance learning classifies subtissue locations in mass spectrometry images from tissue-level annotations

iMSminer: A Data Processing and Machine Learning Package for Imaging Mass Spectrometry

Multimodal MALDI imaging mass spectrometry for improved diagnosis of melanoma

Self-Organizing Maps for Secondary Ion Mass Spectrometry

Advancing the Prediction of MS/MS Spectra Using Machine Learning

MSIGen: An Open-Source Python Package for Processing and Visualizing Mass Spectrometry Imaging Data

A Multimodal SIMS/MALDI Mass Spectrometry Imaging Source with Secondary Electron Imaging Capabilities for Use with timsTOF Instruments

A super-resolution strategy for mass spectrometry imaging via transfer learning

A Machine Learning-Driven Comparison of Ion Images Obtained by MALDI and MALDI-2 Mass Spectrometry Imaging

LSM1-MS2: A Self-Supervised Foundation Model for Tandem Mass Spectrometry Applications, Encompassing Extensive Chemical Property Predictions and Spectral Matching

DeepION: A Deep Learning-Based Low-Dimensional Representation Model of Ion Images for Mass Spectrometry Imaging

Feature Extraction Approach for Mass Spectrometry Imaging Data Using Non-negative Matrix Factorization

Gel-assisted mass spectrometry imaging enables sub-micrometer spatial lipidomics

Evaluation of Digital Image Recognition Methods for Mass Spectrometry Imaging Data Analysis

Advances in MALDI Mass Spectrometry Imaging Single Cell and Tissues