Abstract:Multimodal imaging analyses of dosed tissue samples can provide more comprehensive insights into the effects of a therapeutically active compound on a target tissue compared to single-modal imaging. For example, simultaneous spatial mapping of pharmaceutical compounds and endogenous macromolecule receptors is difficult to achieve in a single imaging experiment. Herein, we present a multimodal workflow combining imaging mass spectrometry with immunohistochemistry (IHC) fluorescence imaging and brightfield microscopy imaging. Imaging mass spectrometry enables direct mapping of pharmaceutical compounds and metabolites, IHC fluorescence imaging can visualize large proteins, and brightfield microscopy imaging provides tissue morphology information. Single-cell resolution images are generally difficult to acquire using imaging mass spectrometry but are readily acquired with IHC fluorescence and brightfield microscopy imaging. Spatial sharpening of mass spectrometry images would thus allow for higher fidelity coregistration with other higher-resolution microscopy images. Imaging mass spectrometry spatial resolution can be predicted to a finer value via a computational image fusion workflow, which models the relationship between the intensity values in the mass spectrometry image and the features of a high-spatial resolution microscopy image. As a proof of concept, our multimodal workflow was applied to brain tissue extracted from a Sprague-Dawley rat dosed with a kratom alkaloid, corynantheidine. Four candidate mathematical models, including linear regression, partial least-squares regression, random forest regression, and two-dimensional convolutional neural network (2-D CNN), were tested. The random forest and 2-D CNN models most accurately predicted the intensity values at each pixel as well as the overall patterns of the mass spectrometry images, while also providing the best spatial resolution enhancements. Herein, image fusion enabled predicted mass spectrometry images of corynantheidine, GABA, and glutamine to approximately 2.5 μm spatial resolutions, a significant improvement compared to the original images acquired at 25 μm spatial resolution. The predicted mass spectrometry images were then coregistered with an H&E image and IHC fluorescence image of the μ-opioid receptor to assess colocalization of corynantheidine with brain cells. Our study also provides insights into the different evaluation parameters to consider when utilizing image fusion for biological applications.

Changes of Mass Spectra Patterns on a Brain Tissue Section Revealed by Deep Learning with Imaging Mass Spectrometry Data

Unsupervised machine learning using an imaging mass spectrometry dataset automatically reassembles grey and white matter

Enhancing Classification of Mass Spectrometry Imaging Data with Deep Neural Networks.

DeepS: Accelerating 3D Mass Spectrometry Imaging via a Deep Neural Network

DeepION: A Deep Learning-Based Low-Dimensional Representation Model of Ion Images for Mass Spectrometry Imaging

Deep learning-assisted mass spectrometry imaging for preliminary screening and pre-classification of psychoactive substances

Peak learning of mass spectrometry imaging data using artificial neural networks

Deep learning for tumor classification in imaging mass spectrometry

[Research progress of deep learning applications in mass spectrometry imaging data analysis]

Multi‐modal mass spectrometry imaging of a single tissue section

MSpectraAI: a powerful platform for deciphering proteome profiling of multi-tumor mass spectrometry data by using deep neural networks

Mass Spectrometry Imaging as a New Method: To Reveal the Pathogenesis and the Mechanism of Traditional Medicine in Cerebral Ischemia

Multimodal Image Fusion Offers Better Spatial Resolution for Mass Spectrometry Imaging

Deep Learning Approach for Dynamic Sampling for Multichannel Mass Spectrometry Imaging

Multi-Center Brain Imaging Classification Using a Novel 3D CNN Approach.

Extended similarity methods for efficient data mining in imaging mass spectrometry

Feature Extraction Approach for Mass Spectrometry Imaging Data Using Non-negative Matrix Factorization

Unsupervised machine learning for exploratory data analysis in imaging mass spectrometry

Multimodal Image Fusion Workflow Incorporating MALDI Imaging Mass Spectrometry and Microscopy for the Study of Small Pharmaceutical Compounds

Machine Learning-Enabled High-Resolution Dynamic Deuterium MR Spectroscopic Imaging

Recurrent and Convolution Neural Networks for Sequential Multispectral Optoacoustic Tomography (MSOT) Imaging