Abstract:Chromatin-sensitive Partial Wave Spectroscopic (csPWS) microscopy offers a non-invasive glimpse into the mass density distribution of cellular structures at the nanoscale, leveraging the spectroscopic information. Such capability allows us to analyze the chromatin structure and organization and the global transcriptional state of the cell nuclei for the study of its role in carcinogenesis. Accurate segmentation of the nuclei in csPWS microscopy images is an essential step in isolating them for further analysis. However, manual segmentation is error-prone, biased, time-consuming, and laborious, resulting in disrupted nuclear boundaries with partial or over-segmentation. Here, we present an innovative deep-learning-driven approach to automate the accurate nuclei segmentation of label-free live cell csPWS microscopy imaging data. Our approach, csPWS-seg, harnesses the Convolutional Neural Networks-based U-Net model with an attention mechanism to automate the accurate cell nuclei segmentation of csPWS microscopy images. We leveraged the structural, physical, and biological differences between the cytoplasm, nucleus, and nuclear periphery to construct three distinct csPWS feature images for nucleus segmentation. Using these images of HCT116 cells, csPWS-seg achieved superior performance with a median Intersection over Union (IoU) of 0.80 and a Dice Similarity Coefficient (DSC) score of 0.88. The csPWS-seg overcame the segmentation performance over the baseline U-Net model and another attention-based model, SE-U-Net, marking a significant improvement in segmentation accuracy. Further, we analyzed the performance of our proposed model with four loss functions: binary cross-entropy loss, focal loss, dice loss, and Jaccard loss. The csPWS-seg with focal loss provided the best results compared to other loss functions. The automatic and accurate nuclei segmentation offered by the csPWS-seg not only automates, accelerates, and streamlines csPWS data analysis but also enhances the reliability of subsequent chromatin analysis research, paving the way for more accurate diagnostics, treatment, and understanding of cellular mechanisms for carcinogenesis.

Deep learning-based identification of sub-nuclear structures in FIB-SEM images

Deep learning based supervised semantic segmentation of Electron Cryo-Subtomograms

Automated Cell Structure Extraction for 3D Electron Microscopy by Deep Learning

Evaluation Of Deep Learning Strategies For Nucleus Segmentation In Fluorescence Images

DeepLearnMOR: a Deep-Learning Framework for Fluorescence Image-Based Classification of Organelle Morphology.

Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations

Deep Learning-Based Subdivision Approach for Large Scale Macromolecules Structure Recovery from Electron Cryo Tomograms

Deep Learning architectures for generalized immunofluorescence based nuclear image segmentation

Automated Nuclear Lamina Network Recognition and Quantitative Analysis in Structured Illumination Super-Resolution Microscope Images Using a Gaussian Mixture Model and Morphological Processing

Deep Mining of Subtle Differences in Cell Morphology Via Deep Learning

A deep learning-based toolkit for 3D nuclei segmentation and quantitative analysis in cellular and tissue context

3D Structure from 2D Microscopy images using Deep Learning

Subcellular structure segmentation from cryo-electron tomograms via machine learning

Deep Neural Networks to Register and Annotate the Cells of the C. elegans Nervous System

Improved deep learning based macromolecules structure classification from electron cryo tomograms

Deep learning to overcome Zernike phase-contrast nanoCT artifacts for automated micro-nano porosity segmentation in bone

Deep learning for three-dimensional segmentation of electron microscopy images of complex ceramic materials

BriFiSeg: a deep learning-based method for semantic and instance segmentation of nuclei in brightfield images

Deep Learning-driven Automatic Nuclei Segmentation of Label-free Live Cell Chromatin-sensitive Partial Wave Spectroscopic Microscopy Imaging

Supervised Machine Learning for Region Assignment of Zebrafish Brain Nuclei based on Computational Assessment of Cell Neighborhoods