Abstract:Mass Spectrometry Imaging (MSI) provides a useful tool to divide a tissue section into sub-regions with similar molecular profiles, namely tissue segmentation. However, owing to the lack of ground truth, there is no reliable evaluation approach to assess the validity of unsupervised segmentation outcomes of MSI. We propose a novel solution grounded on a presumption that a segmentation is reliable if it can be reproduced using distinct bio-information extracted from independent sources. Specifically, besides molecular information from MSI data, we also obtain morphological information over a tissue section from its Hematoxylin-Erosin (H&E) stained histopathological image. MSI has high molecular specificity but low spatial resolving power, the H&E image has no molecular specificity but it can capture microscopic details of the tissue with a spatial resolution two magnitudes higher than MSI. The whole H&E image is split into an array of small patches, which correspond to the spatial pixels of MSI. A spectrum of informative morphological features is computed iteratively for each patch and spatial segmentation can be generated by clustering the patches based on their morphological similarities. Adjusted Mutual Information (AMI) score measures the degree of agreement between MSI-based and H&E image-based segmentation outcomes, which is defined by us as an objective and quantitative evaluation metric of segmentation validity. We investigated various candidate morphological features: a combination of Deep Convolution Neural Network (DCNN) features and handcrafted Threshold Adjacency Statistics (TAS) features finally stood out. The most appropriate number of tissue segments was also determined according to AMI score. Moreover, we introduced Co-Clustering algorithm to MSI data to simultaneously group m/z variables and spatial pixels, so potential biomarkers associated to each sub-region were discovered without the need of further analysis. Eventually, by integrating the segmentation outcomes based on MSI and H&E image data, the confidence level of the segment assignment was displayed for each pixel, which offered a much more informative and compelling way to present the segmentation results.

Delineating regions of interest for mass spectrometry imaging by multimodally corroborated spatial segmentation

Application of clustering strategy for automatic segmentation of tissue regions in mass spectrometry imaging

Towards More Reliable Unsupervised Tissue Segmentation Via Integrating Mass Spectrometry Imaging and Hematoxylin-Erosin Stained Histopathological Image

eLIMS: Ensemble Learning-Based Spatial Segmentation of Mass Spectrometry Imaging to Explore Metabolic Heterogeneity

Isegmsi: an Interactive Strategy to Improve Spatial Segmentation of Mass Spectrometry Imaging Data.

Spatial segmentation of mass spectrometry imaging data featuring selected principal components

Data Filtering and Its Prioritization in Pipelines for Spatial Segmentation of Mass Spectrometry Imaging

A Multimodal Pipeline for Image Correction and Registration of Mass Spectrometry Imaging with Microscopy

TransMetaSegmentation (TMS): a transcriptome-based segmentation method for spatial metabolomic data

Self-supervised clustering analysis of colorectal cancer biomarkers based on multi-scale whole slides image and mass spectrometry imaging fused images

Tandem Mass Spectrometry Imaging Enables High Definition for Mapping Lipids in Tissues

Deep Learning Based Multi-Organ Segmentation And Metastases Segmentation In Whole Mouse Body And The Cryo-Imaging Cancer Imaging And Therapy Analysis Platform (Citap)

Multi‐modal mass spectrometry imaging of a single tissue section

Untargeted Pixel-by-Pixel Imaging of Metabolite Ratio Pairs as a Novel Tool for Biomedical Discovery in Mass Spectrometry Imaging

Feature Extraction Approach for Mass Spectrometry Imaging Data Using Non-negative Matrix Factorization

Isoporous Membrane Mediated Imprinting Mass Spectrometry Imaging for Spatially-Resolved Metabolomics and Rapid Histopathological Diagnosis

Data-Driven Deciphering of Latent Lesions in Heterogeneous Tissue Using Function-Directed t-SNE of Mass Spectrometry Imaging Data

Automatic 3D Nonlinear Registration of Mass Spectrometry Imaging and Magnetic Resonance Imaging Data

Correlative Imaging for Comprehensive Molecular Mapping of Individual Cell Types in Biological Tissues

Mass Spectrometry Imaging and Integration with Other Imaging Modalities for Greater Molecular Understanding of Biological Tissues

SoRC -- Evaluation of Computational Molecular Co-Localization Analysis in Mass Spectrometry Images