Abstract:Multi-modal imaging analyses of dosed tissue samples can provide more comprehensive insight into the effects of a therapeutically active compound on a target tissue compared to single-modal imaging. For example, simultaneous spatial mapping of pharmaceutical compounds and endogenous macromolecule receptors is difficult to achieve in a single imaging experiment. Herein, we present a multi-modal workflow combining imaging mass spectrometry with immunohistochemistry (IHC) fluorescence imaging and brightfield microscopy imaging. Imaging mass spectrometry enables direct mapping of pharmaceutical compounds and metabolites, IHC fluorescence imaging can visualize large proteins, and brightfield microscopy imaging provides tissue morphology information. Single-cell resolution images are generally difficult to acquire using imaging mass spectrometry, but are readily acquired with IHC fluorescence and brightfield microscopy imaging. Spatial sharpening of mass spectrometry images would thus allow for higher fidelity co-registration with higher resolution microscopy images. Imaging mass spectrometry spatial resolution can be predicted to a finer value via a computational image fusion workflow, which models the relationship between the intensity values in the mass spectrometry image and the features of a high spatial resolution microscopy image. As a proof of concept, our multi-modal workflow was applied to brain tissue extracted from a Sprague Dawley rat dosed with a kratom alkaloid, corynantheidine. Four candidate mathematical models including linear regression, partial least squares regression (PLS), random forest regression, and two-dimensional convolutional neural network (2-D CNN), were tested. The random forest and 2-D CNN models most accurately predicted the intensity values at each pixel as well as the overall patterns of the mass spectrometry images, while also providing the best spatial resolution enhancements. Herein, image fusion enabled predicted mass spectrometry images of corynantheidine, GABA, and glutamine to approximately 2.5 μm spatial resolutions, a significant improvement compared to the original images acquired at 25 μm spatial resolution. The predicted mass spectrometry images were then co-registered with an H&E image and IHC fluorescence image of the μ- opioid receptor to assess co-localization of corynantheidine with brain cells. Our study also provides insight into the different evaluation parameters to consider when utilizing image fusion for biological applications.

Metabolomics Data Fusion Between Near Infrared Spectroscopy and High-Resolution Mass Spectrometry: A Synergetic Approach to Boost Performance or Induce Confusion.

Data Fusion Strategy Based on Near Infrared Spectra and Ultraviolet Spectra for Simultaneous Determination of Ginsenosides and Saccharides in Chinese Herbal Injection

A Hyperspectral Imaging Approach for Classifying Geographical Origins of Rhizoma Atractylodis Macrocephalae Using the Fusion of Spectrum-Image in VNIR and SWIR Ranges (Vnir-Swir-fusi)

Application of Data Fusion in Traditional Chinese Medicine: A Review

High-level Fusion Coupled with Mahalanobis Distance Weighted (MDW) Method for Multivariate Calibration

NIR and MIR Spectral Data Fusion for Rapid Detection of Lonicera Japonica and Artemisia Annua by Liquid Extraction Process

Data fusion of near-infrared and mid-infrared spectroscopy for rapid origin identification and quality evaluation of Lonicerae japonicae flos

The Effect of Data Integration on LC-MS-based Metabolomics Data: Evaluation on the Comparative Classification Capacities

Study on chromatographic data pre-processing using fuzzy decision making in metabonomics.

FT-MIR and NIR spectral data fusion: a synergetic strategy for the geographical traceability of Panax notoginseng

Data Fusion of Raman and Near-Infrared Spectroscopies for the Rapid Quantitative Analysis of Methanol Content in Methanol–Gasoline

Direct Infusion-Three-Dimensional-Mass Spectrometry Enables Rapid Chemome Comparison among Herbal Medicines

Data fusion of synchronous fluorescence and surface enhanced Raman scattering spectroscopies for geographical origin traceability of Atractylodes macrocephala Koidz

Multimodal Image Fusion Workflow Incorporating MALDI Imaging Mass Spectrometry and Microscopy for the Study of Small Pharmaceutical Compounds

Rapid Recognition of Geoherbalism and Authenticity of a Chinese Herb by Data Fusion of Near-Infrared Spectroscopy (NIR) and Mid-Infrared (MIR) Spectroscopy Combined with Chemometrics

MULTI-MODAL DATA FUSION SCHEMES FOR INTEGRATED CLASSIFICATION OF IMAGING AND NON-IMAGING BIOMEDICAL DATA

Discrimination of Boletaceae mushrooms based on data fusion of FT-IR and ICP–AES combined with SVM

A multi-modal image fusion workflow incorporating MALDI imaging mass spectrometry and microscopy for the study of small pharmaceutical compounds

Quality assessment of traditional Chinese medicine based on data fusion combined with machine learning: A review

A proposed protocol based on integrative metabonomics analysis for the rapid detection and mechanistic understanding of sulfur fumigation of Chinese herbal medicines

A graph density-based strategy for features fusion from different peak extract software to achieve more metabolites in metabolic profiling from high-resolution mass spectrometry