Abstract:Chromatin-sensitive Partial Wave Spectroscopic (csPWS) microscopy offers a non-invasive glimpse into the mass density distribution of cellular structures at the nanoscale, leveraging the spectroscopic information. Such capability allows us to analyze the chromatin structure and organization and the global transcriptional state of the cell nuclei for the study of its role in carcinogenesis. Accurate segmentation of the nuclei in csPWS microscopy images is an essential step in isolating them for further analysis. However, manual segmentation is error-prone, biased, time-consuming, and laborious, resulting in disrupted nuclear boundaries with partial or over-segmentation. Here, we present an innovative deep-learning-driven approach to automate the accurate nuclei segmentation of label-free live cell csPWS microscopy imaging data. Our approach, csPWS-seg, harnesses the Convolutional Neural Networks-based U-Net model with an attention mechanism to automate the accurate cell nuclei segmentation of csPWS microscopy images. We leveraged the structural, physical, and biological differences between the cytoplasm, nucleus, and nuclear periphery to construct three distinct csPWS feature images for nucleus segmentation. Using these images of HCT116 cells, csPWS-seg achieved superior performance with a median Intersection over Union (IoU) of 0.80 and a Dice Similarity Coefficient (DSC) score of 0.88. The csPWS-seg overcame the segmentation performance over the baseline U-Net model and another attention-based model, SE-U-Net, marking a significant improvement in segmentation accuracy. Further, we analyzed the performance of our proposed model with four loss functions: binary cross-entropy loss, focal loss, dice loss, and Jaccard loss. The csPWS-seg with focal loss provided the best results compared to other loss functions. The automatic and accurate nuclei segmentation offered by the csPWS-seg not only automates, accelerates, and streamlines csPWS data analysis but also enhances the reliability of subsequent chromatin analysis research, paving the way for more accurate diagnostics, treatment, and understanding of cellular mechanisms for carcinogenesis.

Deep learning based hybrid ghost-net for metaspread chromosome image segmentation

Enhanced Rotated Mask R-CNN for Chromosome Segmentation.

Chromosome Segmentation Analysis Using Image Processing Techniques and Autoencoders

An automatic progressive chromosome segmentation approach using deep learning with traditional image processing

Deep Neural Network-Based Automatic Dicentric Chromosome Detection Using a Model Pretrained on Common Objects

DeepACEv2: Automated Chromosome Enumeration in Metaphase Cell Images Using Deep Convolutional Neural Networks

CIS-Net: an End-to-end Chromosome Instance Segmentation Method Based on Disturbance Features Deactivation and Strengthened Disparity

A Multi-Stages Chromosome Segmentation and Mixed Classification Method for Chromosome Automatic Karyotyping

High-resolution deep transferred ASPPU-Net for nuclei segmentation of histopathology images

A novel chromosome instance segmentation method based on geometry and deep learning

Attention-Based Densely Connected Convolutional Network for Chromosome Classification.

Classification of analyzable metaphase images using transfer learning and fine tuning

Chromosome Detection in Metaphase Cell Images Using Morphological Priors

Deep Learning-driven Automatic Nuclei Segmentation of Label-free Live Cell Chromatin-sensitive Partial Wave Spectroscopic Microscopy Imaging

DeepACC:Automate Chromosome Classification based on Metaphase Images using Deep Learning Framework Fused with Prior Knowledge

MixNet: A Better Promising Approach for Chromosome Classification based on Aggregated Residual Architecture

CellSegNet: an Adaptive Multi-Resolution Hybrid Network for Cell Segmentation

An Improved Denoising of G-banding Chromosome Images Using Cascaded CNN and Binary Classification Network

DaCSeg: Divide and conquer for accurate overlapping chromosome instance segmentation in metaphase cell images

Statistical Karyotype Analysis Using Cnn And Geometric Optimization