Abstract:Mass Spectrometry Imaging (MSI) provides a useful tool to divide a tissue section into sub-regions with similar molecular profiles, namely tissue segmentation. However, owing to the lack of ground truth, there is no reliable evaluation approach to assess the validity of unsupervised segmentation outcomes of MSI. We propose a novel solution grounded on a presumption that a segmentation is reliable if it can be reproduced using distinct bio-information extracted from independent sources. Specifically, besides molecular information from MSI data, we also obtain morphological information over a tissue section from its Hematoxylin-Erosin (H&E) stained histopathological image. MSI has high molecular specificity but low spatial resolving power, the H&E image has no molecular specificity but it can capture microscopic details of the tissue with a spatial resolution two magnitudes higher than MSI. The whole H&E image is split into an array of small patches, which correspond to the spatial pixels of MSI. A spectrum of informative morphological features is computed iteratively for each patch and spatial segmentation can be generated by clustering the patches based on their morphological similarities. Adjusted Mutual Information (AMI) score measures the degree of agreement between MSI-based and H&E image-based segmentation outcomes, which is defined by us as an objective and quantitative evaluation metric of segmentation validity. We investigated various candidate morphological features: a combination of Deep Convolution Neural Network (DCNN) features and handcrafted Threshold Adjacency Statistics (TAS) features finally stood out. The most appropriate number of tissue segments was also determined according to AMI score. Moreover, we introduced Co-Clustering algorithm to MSI data to simultaneously group m/z variables and spatial pixels, so potential biomarkers associated to each sub-region were discovered without the need of further analysis. Eventually, by integrating the segmentation outcomes based on MSI and H&E image data, the confidence level of the segment assignment was displayed for each pixel, which offered a much more informative and compelling way to present the segmentation results.

Lipid Segmentation Method Based on Magnification Endoscopy with Narrow-Band Imaging

Multispectral Endoscopic Imaging Studies on the Tissue Components of Gastrointestinal Mucosa

Hue-texture-embedded region-based model for magnifying endoscopy with narrow-band imaging image segmentation based on visual features

An enhanced narrow-band imaging method for the microvessel detection

Comprehensive Advancement in Endoscopy: Optical Design, Algorithm Enhancement, and Clinical Validation for Merged WLI and CBI Imaging

Automatic Lumen Segmentation in Intravascular Optical Coherence Tomography Using Morphological Features

Automated Segmentation of Low Contrast Endothelial Cell Images for Fluorescent Intensity Measurement

Lip Segmentation Based on Facial Complexion Template

A medical image segmentation method for rectal tumors based on multi‐scale feature retention and multiple attention mechanisms

Image Segmentation Directed to Automatic Analysis of Quantitative Index of Liver Tissue Fibrosis

Lesion Segmentation and Identification of Breast Tumor on Dynamic Contrast-Enhanced Magnetic Resonance Imaging

An Efficient Image Segmentation Method with Application to Cell Images

Towards More Reliable Unsupervised Tissue Segmentation Via Integrating Mass Spectrometry Imaging and Hematoxylin-Erosin Stained Histopathological Image

Delineating regions of interest for mass spectrometry imaging by multimodally corroborated spatial segmentation

A STUDY OF THE SEGMENTATION FOR LASER SCANNING CONFOCAL MICROSCOPIC BIOMEDICAL IMAGES

Diagnosis and segmentation effect of the ME-NBI-based deep learning model on gastric neoplasms in patients with suspected superficial lesions - a multicenter study

Automatic and Robust Segmentation of Endoscopic OCT Images and Optical Staining.

Image Segmentation of Endoscopic Cataract Based on Semantic Segmentation

Multi-threshold image segmentation based on an improved whale optimization algorithm: A case study of Lupus Nephritis

Robust Lip Segmentation Based on Complexion Mixture Model.

Asymmetrical Illumination Enables Lipid Droplets Segmentation in Caenorhabditis elegans Using Epi-Illumination Dark Field Microscopy