Abstract:Mass Spectrometry Imaging (MSI) provides a useful tool to divide a tissue section into sub-regions with similar molecular profiles, namely tissue segmentation. However, owing to the lack of ground truth, there is no reliable evaluation approach to assess the validity of unsupervised segmentation outcomes of MSI. We propose a novel solution grounded on a presumption that a segmentation is reliable if it can be reproduced using distinct bio-information extracted from independent sources. Specifically, besides molecular information from MSI data, we also obtain morphological information over a tissue section from its Hematoxylin-Erosin (H&E) stained histopathological image. MSI has high molecular specificity but low spatial resolving power, the H&E image has no molecular specificity but it can capture microscopic details of the tissue with a spatial resolution two magnitudes higher than MSI. The whole H&E image is split into an array of small patches, which correspond to the spatial pixels of MSI. A spectrum of informative morphological features is computed iteratively for each patch and spatial segmentation can be generated by clustering the patches based on their morphological similarities. Adjusted Mutual Information (AMI) score measures the degree of agreement between MSI-based and H&E image-based segmentation outcomes, which is defined by us as an objective and quantitative evaluation metric of segmentation validity. We investigated various candidate morphological features: a combination of Deep Convolution Neural Network (DCNN) features and handcrafted Threshold Adjacency Statistics (TAS) features finally stood out. The most appropriate number of tissue segments was also determined according to AMI score. Moreover, we introduced Co-Clustering algorithm to MSI data to simultaneously group m/z variables and spatial pixels, so potential biomarkers associated to each sub-region were discovered without the need of further analysis. Eventually, by integrating the segmentation outcomes based on MSI and H&E image data, the confidence level of the segment assignment was displayed for each pixel, which offered a much more informative and compelling way to present the segmentation results.

Isegmsi: an Interactive Strategy to Improve Spatial Segmentation of Mass Spectrometry Imaging Data.

Application of clustering strategy for automatic segmentation of tissue regions in mass spectrometry imaging

Delineating regions of interest for mass spectrometry imaging by multimodally corroborated spatial segmentation

eLIMS: Ensemble Learning-Based Spatial Segmentation of Mass Spectrometry Imaging to Explore Metabolic Heterogeneity

Towards More Reliable Unsupervised Tissue Segmentation Via Integrating Mass Spectrometry Imaging and Hematoxylin-Erosin Stained Histopathological Image

Data Filtering and Its Prioritization in Pipelines for Spatial Segmentation of Mass Spectrometry Imaging

Spatial segmentation of mass spectrometry imaging data featuring selected principal components

Exploring a novel HE image segmentation technique for glioblastoma: A hybrid slime mould and differential evolution approach

Skeleton-Guided Instance Separation for Fine-Grained Segmentation in Microscopy

Multi-MSIProcessor: Data Visualizing and Analysis Software for Spatial Metabolomics Research

TransMetaSegmentation (TMS): a transcriptome-based segmentation method for spatial metabolomic data

AI-assisted mass spectrometry imaging with in situ image segmentation for subcellular metabolomics analysis

QIS : Interactive Segmentation via Quasi-Conformal Mappings

Recent Advances in Mass Spectrometry Imaging Combined with Artificial Intelligence for Spatially Clarifying Molecular Profiles: Toward Biomedical Applications

Feature Extraction Approach for Mass Spectrometry Imaging Data Using Non-negative Matrix Factorization

From molecules to visuals: Empowering drug discovery and development with mass spectrometry imaging

An effective and open source interactive 3D medical image segmentation solution

Adaptive Interactive Segmentation for Multimodal Medical Imaging via Selection Engine

MSI-UNet: A Flexible UNet-Based Multi-Scale Interactive Framework for 3D Gastric Tumor Segmentation on CT Scans

Sequential Interactive Image Segmentation

Self-supervised clustering analysis of colorectal cancer biomarkers based on multi-scale whole slides image and mass spectrometry imaging fused images