Exploring the Knowledge of Human Expert beyond His Willing Expression

P. Augustyniak

DOI: https://doi.org/10.1007/978-3-540-68168-7_1

Abstract:

What problem does this paper attempt to address?

Evaluation Of Deep Learning Strategies For Nucleus Segmentation In Fluorescence Images

Juan C. Caicedo,Jonathan Roth,Allen Goodman,Tim Becker,Kyle W. Karhohs,Matthieu Broisin,Csaba Molnar,Claire Mcquin,Shantanu Singh,Fabian J. Theis,Anne E. Carpenter

DOI: https://doi.org/10.1002/cyto.a.23863

IF: 4.714

2019-01-01

Cytometry Part A

Abstract:Identifying nuclei is often a critical first step in analyzing microscopy images of cells and classical image processing algorithms are most commonly used for this task. Recent developments in deep learning can yield superior accuracy, but typical evaluation metrics for nucleus segmentation do not satisfactorily capture error modes that are relevant in cellular images. We present an evaluation framework to measure accuracy, types of errors, and computational efficiency; and use it to compare deep learning strategies and classical approaches. We publicly release a set of 23,165 manually annotated nuclei and source code to reproduce experiments and run the proposed evaluation methodology. Our evaluation framework shows that deep learning improves accuracy and can reduce the number of biologically relevant errors by half. (c) 2019 The Authors. Cytometry Part A published by Wiley Periodicals, Inc. on behalf of International Society for Advancement of Cytometry.
Mutual-Complementing Framework for Nuclei Detection and Segmentation in Pathology Image

Zunlei Feng,Zhonghua Wang,Xinchao Wang,Yining Mao,Thomas Li,Jie Lei,Yuexuan Wang,Mingli Song

DOI: https://doi.org/10.1109/iccv48922.2021.00400

2021-01-01

Abstract:Detection and segmentation of nuclei are fundamental analysis operations in pathology images, the assessments derived from which serve as the gold standard for cancer diagnosis. Manual segmenting nuclei is expensive and timeconsuming. What’s more, accurate segmentation detection of nuclei can be challenging due to the large appearance variation, conjoined and overlapping nuclei, and serious degeneration of histological structures. Supervised methods highly rely on massive annotated samples. The existing two unsupervised methods are prone to failure on degenerated samples. This paper proposes a Mutual-Complementing Framework (MCF) for nuclei detection and segmentation in pathology images. Two branches of MCF are trained in the mutual-complementing manner, where the detection branch complements the pseudo mask of the segmentation branch, while the progressive trained segmentation branch complements the missing nucleus templates through calculating the mask residual between the predicted mask and detected result. In the detection branch, two response map fusion strategies and gradient direction based postprocessing are devised to obtain the optimal detection response. Furthermore, the confidence loss combined with the synthetic samples and self-finetuning is adopted to train the segmentation network with only high confidence areas. Extensive experiments demonstrate that MCF achieves comparable performance with only a few nucleus patches as supervision. Especially, MCF possesses good robustness (only dropping by about 6%) on degenerated samples, which are critical and common cases in clinical diagnosis.
aiSEGcell: User-friendly deep learning-based segmentation of nuclei in transmitted light images

Daniel Schirmacher,Ümmünur Armagan,Yang Zhang,Tobias Kull,Markus Auler,Timm Schroeder

DOI: https://doi.org/10.1371/journal.pcbi.1012361

2024-08-23

Abstract:Segmentation is required to quantify cellular structures in microscopic images. This typically requires their fluorescent labeling. Convolutional neural networks (CNNs) can detect these structures also in only transmitted light images. This eliminates the need for transgenic or dye fluorescent labeling, frees up imaging channels, reduces phototoxicity and speeds up imaging. However, this approach currently requires optimized experimental conditions and computational specialists. Here, we introduce "aiSEGcell" a user-friendly CNN-based software to segment nuclei and cells in bright field images. We extensively evaluated it for nucleus segmentation in different primary cell types in 2D cultures from different imaging modalities in hand-curated published and novel imaging data sets. We provide this curated ground-truth data with 1.1 million nuclei in 20,000 images. aiSEGcell accurately segments nuclei from even challenging bright field images, very similar to manual segmentation. It retains biologically relevant information, e.g. for demanding quantification of noisy biosensors reporting signaling pathway activity dynamics. aiSEGcell is readily adaptable to new use cases with only 32 images required for retraining. aiSEGcell is accessible through both a command line, and a napari graphical user interface. It is agnostic to computational environments and does not require user expert coding experience.
A deep learning algorithm for one-step contour aware nuclei segmentation of histopathology images

Yuxin Cui,Guiying Zhang,Zhonghao Liu,Zheng Xiong,Jianjun Hu

DOI: https://doi.org/10.1007/s11517-019-02008-8

2019-07-26

Abstract:This paper addresses the task of nuclei segmentation in high-resolution histopathology images. We propose an automatic end-to-end deep neural network algorithm for segmentation of individual nuclei. A nucleus-boundary model is introduced to predict nuclei and their boundaries simultaneously using a fully convolutional neural network. Given a color-normalized image, the model directly outputs an estimated nuclei map and a boundary map. A simple, fast, and parameter-free post-processing procedure is performed on the estimated nuclei map to produce the final segmented nuclei. An overlapped patch extraction and assembling method is also designed for seamless prediction of nuclei in large whole-slide images. We also show the effectiveness of data augmentation methods for nuclei segmentation task. Our experiments showed our method outperforms prior state-of-the-art methods. Moreover, it is efficient that one 1000×1000 image can be segmented in less than 5 s. This makes it possible to precisely segment the whole-slide image in acceptable time. The source code is available at https://github.com/easycui/nuclei_segmentation.The neural network for nuclei segmentation

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,medical informatics
Deep Learning Model for Cell Nuclei Segmentation and Lymphocyte Identification in Whole Slide Histology Images

P. Treigys,Elzbieta Budginaitė,A. Laurinavičius,M. Morkunas

DOI: https://doi.org/10.15388/20-INFOR442

Informatica

Abstract:. Anti-cancer immunotherapy dramatically changes the clinical management of many types of tumours towards less harmful and more personalized treatment plans than conventional chemotherapy or radiation. Precise analysis of the spatial distribution of immune cells in the tu-mourous tissue is necessary to select patients that would best respond to the treatment. Here, we introduce a deep learning-based workﬂow for cell nuclei segmentation and subsequent immune cell identiﬁcation in routine diagnostic images. We applied our workﬂow on a set of hematoxylin and eosin (H&E) stained breast cancer and colorectal cancer tissue images to detect tumour-inﬁltrating lymphocytes. Firstly, to segment all nuclei in the tissue, we applied the multiple-image input layer architecture (Micro-Net, Dice coeﬃcient (DC) 0 . 79 ± 0 . 02 ). We supplemented the Micro-Net with an introduced texture block to increase segmentation accuracy (DC = 0 . 80 ± 0 . 02 ). We preserved the shallow architecture of the segmentation network with only 280 K trainable parameters (e.g. U-net with ∼ 1900 K parameters, DC = 0 . 78 ± 0 . 03 ). Subsequently, we added an active contour layer to the ground truth images to further increase the performance (DC = 0 . 81 ± 0 . 02 ). Secondly, to discriminate lymphocytes from the set of all segmented nuclei, we explored multilayer perceptron and achieved a 0.70 classiﬁcation f-score. Remarkably, the binary classiﬁcation of segmented nuclei was signiﬁcantly improved (f-score = 0.80) by colour normalization. To inspect model generalization, we have evaluated trained models on a public dataset that was not put to use during training. We conclude that the proposed workﬂow achieved promising results and, with little eﬀort, can be employed in multi-class nuclei segmentation and identiﬁcation tasks.

Medicine,Computer Science
Enhancing Multi-tissue and Multi-scale Cell Nuclei Segmentation with Deep Metric Learning

Tomas Iesmantas,Agne Paulauskaite-Taraseviciene,Kristina Sutiene

DOI: https://doi.org/10.3390/app10020615

2020-01-15

Applied Sciences

Abstract:(1) Background: The segmentation of cell nuclei is an essential task in a wide range of biomedical studies and clinical practices. The full automation of this process remains a challenge due to intra- and internuclear variations across a wide range of tissue morphologies, differences in staining protocols and imaging procedures. (2) Methods: A deep learning model with metric embeddings such as contrastive loss and triplet loss with semi-hard negative mining is proposed in order to accurately segment cell nuclei in a diverse set of microscopy images. The effectiveness of the proposed model was tested on a large-scale multi-tissue collection of microscopy image sets. (3) Results: The use of deep metric learning increased the overall segmentation prediction by 3.12% in the average value of Dice similarity coefficients as compared to no metric learning. In particular, the largest gain was observed for segmenting cell nuclei in H&E -stained images when deep learning network and triplet loss with semi-hard negative mining were considered for the task. (4) Conclusion: We conclude that deep metric learning gives an additional boost to the overall learning process and consequently improves the segmentation performance. Notably, the improvement ranges approximately between 0.13% and 22.31% for different types of images in the terms of Dice coefficients when compared to no metric deep learning.
Deep Learning architectures for generalized immunofluorescence based nuclear image segmentation

Florian Kromp,Lukas Fischer,Eva Bozsaky,Inge Ambros,Wolfgang Doerr,Sabine Taschner-Mandl,Peter Ambros,Allan Hanbury

DOI: https://doi.org/10.48550/arXiv.1907.12975

2019-07-30

Computer Vision and Pattern Recognition

Abstract:Separating and labeling each instance of a nucleus (instance-aware segmentation) is the key challenge in segmenting single cell nuclei on fluorescence microscopy images. Deep Neural Networks can learn the implicit transformation of a nuclear image into a probability map indicating the class membership of each pixel (nucleus or background), but the use of post-processing steps to turn the probability map into a labeled object mask is error-prone. This especially accounts for nuclear images of tissue sections and nuclear images across varying tissue preparations. In this work, we aim to evaluate the performance of state-of-the-art deep learning architectures to segment nuclei in fluorescence images of various tissue origins and sample preparation types without post-processing. We compare architectures that operate on pixel to pixel translation and an architecture that operates on object detection and subsequent locally applied segmentation. In addition, we propose a novel strategy to create artificial images to extend the training set. We evaluate the influence of ground truth annotation quality, image scale and segmentation complexity on segmentation performance. Results show that three out of four deep learning architectures (U-Net, U-Net with ResNet34 backbone, Mask R-CNN) can segment fluorescent nuclear images on most of the sample preparation types and tissue origins with satisfactory segmentation performance. Mask R-CNN, an architecture designed to address instance aware segmentation tasks, outperforms other architectures. Equal nuclear mean size, consistent nuclear annotations and the use of artificially generated images result in overall acceptable precision and recall across different tissues and sample preparation types.
Efficient Multi-Organ Multi-Center Cell Nuclei Segmentation Method Based on Deep Learnable Aggregation Network

Loay Hassan,Adel Saleh,Mohamed Abdel-Nasser,Osama A. Omer,Domenec Puig

DOI: https://doi.org/10.18280/ts.380312

IF: 2.299

2021-06-30

Traitement du signal

Abstract:Automated cell nuclei delineation in whole-slide imaging (WSI) is a fundamental step for many tasks like cancer cell recognition, cancer grading, and cancer subtype classification. Although numerous computational methods have been proposed for segmenting nuclei in WSI images based on image processing and deep learning, existing approaches face major challenges such as color variation due to the use of different stains, the various structures of cell nuclei, and the overlapping and clumped cell nuclei. To circumvent these challenges in this article, we propose an efficient and accurate cell nuclei segmentation method based on deep learning, in which a set of accurate individual cell nuclei segmentation models are developed to predict rough segmentation masks, and then a learnable aggregation network (LANet) is used to predict the final nuclei masks. Besides, we develop cell nuclei segmentation software (with a graphical user interface—GUI) that includes the proposed method and other deep-learning-based cell nuclei segmentation methods. A challenging WSI dataset collected from different centers and organs is used to demonstrate the efficiency of our method. The experimental results reveal that our method obtains a competitive performance compared to the existing approaches in terms of the aggregated Jaccard index (AJI=89.25%) and F1-score (F1=73.02%). The developed nuclei segmentation software can be downloaded from https://github.com/loaysh2010/Cell-Nuclei-Segmentation-GUI-Application.

computer science, artificial intelligence,engineering, electrical & electronic
Deep Learning-driven Automatic Nuclei Segmentation of Label-free Live Cell Chromatin-sensitive Partial Wave Spectroscopic Microscopy Imaging

Sunil Kumar Gaire,Md Shahin Alom,Ali Daneshkhah,Nicolas Acosta,Nick Anthony,Emily Pujadas,Vadim Backman

DOI: https://doi.org/10.1101/2024.08.20.608885

2024-08-21

Abstract:Chromatin-sensitive Partial Wave Spectroscopic (csPWS) microscopy offers a non-invasive glimpse into the mass density distribution of cellular structures at the nanoscale, leveraging the spectroscopic information. Such capability allows us to analyze the chromatin structure and organization and the global transcriptional state of the cell nuclei for the study of its role in carcinogenesis. Accurate segmentation of the nuclei in csPWS microscopy images is an essential step in isolating them for further analysis. However, manual segmentation is error-prone, biased, time-consuming, and laborious, resulting in disrupted nuclear boundaries with partial or over-segmentation. Here, we present an innovative deep-learning-driven approach to automate the accurate nuclei segmentation of label-free live cell csPWS microscopy imaging data. Our approach, csPWS-seg, harnesses the Convolutional Neural Networks-based U-Net model with an attention mechanism to automate the accurate cell nuclei segmentation of csPWS microscopy images. We leveraged the structural, physical, and biological differences between the cytoplasm, nucleus, and nuclear periphery to construct three distinct csPWS feature images for nucleus segmentation. Using these images of HCT116 cells, csPWS-seg achieved superior performance with a median Intersection over Union (IoU) of 0.80 and a Dice Similarity Coefficient (DSC) score of 0.88. The csPWS-seg overcame the segmentation performance over the baseline U-Net model and another attention-based model, SE-U-Net, marking a significant improvement in segmentation accuracy. Further, we analyzed the performance of our proposed model with four loss functions: binary cross-entropy loss, focal loss, dice loss, and Jaccard loss. The csPWS-seg with focal loss provided the best results compared to other loss functions. The automatic and accurate nuclei segmentation offered by the csPWS-seg not only automates, accelerates, and streamlines csPWS data analysis but also enhances the reliability of subsequent chromatin analysis research, paving the way for more accurate diagnostics, treatment, and understanding of cellular mechanisms for carcinogenesis.

Biology
Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images

Faisal Mahmood,Daniel Borders,Richard Chen,Gregory N. McKay,Kevan J. Salimian,Alexander Baras,Nicholas J. Durr

DOI: https://doi.org/10.48550/arXiv.1810.00236

2018-10-20

Abstract:Nuclei segmentation is a fundamental task that is critical for various computational pathology applications including nuclei morphology analysis, cell type classification, and cancer grading. Conventional vision-based methods for nuclei segmentation struggle in challenging cases and deep learning approaches have proven to be more robust and generalizable. However, CNNs require large amounts of labeled histopathology data. Moreover, conventional CNN-based approaches lack structured prediction capabilities which are required to distinguish overlapping and clumped nuclei. Here, we present an approach to nuclei segmentation that overcomes these challenges by utilizing a conditional generative adversarial network (cGAN) trained with synthetic and real data. We generate a large dataset of H&E training images with perfect nuclei segmentation labels using an unpaired GAN framework. This synthetic data along with real histopathology data from six different organs are used to train a conditional GAN with spectral normalization and gradient penalty for nuclei segmentation. This adversarial regression framework enforces higher order consistency when compared to conventional CNN models. We demonstrate that this nuclei segmentation approach generalizes across different organs, sites, patients and disease states, and outperforms conventional approaches, especially in isolating individual and overlapping nuclei.

Computer Vision and Pattern Recognition
Propanil (3,4-dichloropropionanilide)-induced methemoglobin formation in mice in relation to acylamidase activity.

S. Singleton,S. D. Murphy

DOI: https://doi.org/10.1016/0041-008X(73)90158-0

IF: 4.46

1973-05-01

Toxicology and Applied Pharmacology

Abstract:
Diffusion-based Data Augmentation for Nuclei Image Segmentation

Xinyi Yu,Guanbin Li,Wei Lou,Siqi Liu,Xiang Wan,Yan Chen,Haofeng Li

DOI: https://doi.org/10.48550/arXiv.2310.14197

2023-10-22

Image and Video Processing

Abstract:Nuclei segmentation is a fundamental but challenging task in the quantitative analysis of histopathology images. Although fully-supervised deep learning-based methods have made significant progress, a large number of labeled images are required to achieve great segmentation performance. Considering that manually labeling all nuclei instances for a dataset is inefficient, obtaining a large-scale human-annotated dataset is time-consuming and labor-intensive. Therefore, augmenting a dataset with only a few labeled images to improve the segmentation performance is of significant research and application value. In this paper, we introduce the first diffusion-based augmentation method for nuclei segmentation. The idea is to synthesize a large number of labeled images to facilitate training the segmentation model. To achieve this, we propose a two-step strategy. In the first step, we train an unconditional diffusion model to synthesize the Nuclei Structure that is defined as the representation of pixel-level semantic and distance transform. Each synthetic nuclei structure will serve as a constraint on histopathology image synthesis and is further post-processed to be an instance map. In the second step, we train a conditioned diffusion model to synthesize histopathology images based on nuclei structures. The synthetic histopathology images paired with synthetic instance maps will be added to the real dataset for training the segmentation model. The experimental results show that by augmenting 10% labeled real dataset with synthetic samples, one can achieve comparable segmentation results with the fully-supervised baseline.
Nucleus segmentation from the histopathological images of liver cancer through an efficient deep learning framework

Sunesh

DOI: https://doi.org/10.1007/s11042-024-18705-y

IF: 2.577

2024-03-28

Multimedia Tools and Applications

Abstract:Segmenting nuclei in histopathological images presents challenges due to variable sizes and overlapping regions, compounded by inter-class heterogeneity in shape and function. To overcome these, we proposed a robust deep learning architecture integrated with a novel edge detection technique based on local standard deviation. This method efficiently identifies nuclei edges, even at Multiscale levels, by exploiting the relationship between local standard deviation and image features. Our CNN architecture consists of stable residual, bottleneck, and attention decoding blocks, enabling effective extraction of high-level semantics and precise image localization. Evaluation on H&E stained liver disease histopathological images and a multi-organ database showcases the effectiveness of our approach, comparable to modern deep neural networks. Three performance indicators are computed to statistically assess segmentation efficacy, consistently demonstrating the superiority of our method over others. For multi-organ dataset segmentation using proposed methods attains the Jaccard index (89.99%), Precision (91.5%), Recall (91.1%), F1-measure (91.27%), and Accuracy (95.42%). Similarly for liver dataset attains Jaccard index (65.72%), Precision (88.74%), Recall (89.53%), F1-measure (90.12%), and Accuracy (94.85%). By addressing the limitations of previous unsupervised methods, our approach offers a robust solution for nuclei segmentation across diverse datasets. The significance of our work lies in its potential to enhance automated nuclei recognition in medical diagnosis and research, facilitating more accurate analysis of histopathological images and ultimately contributing to improved patient care and understanding of disease pathology.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Learn to segment single cells with deep distance estimator and deep cell detector

Weikang Wang,David A.Taft,Yi-Jiun Chen,Jingyu Zhang,Callen T. Wallace,Min Xu,Simon C. Watkins,Jianhua Xing

DOI: https://doi.org/10.48550/arXiv.1803.10829

2019-04-23

Abstract:Single cell segmentation is critical and challenging in live cell imaging data analysis. Traditional image processing methods and tools require time-consuming and labor-intensive efforts of manually fine-tuning parameters. Slight variations of image setting may lead to poor segmentation results. Recent development of deep convolutional neural networks(CNN) provides a potentially efficient, general and robust method for segmentation. Most existing CNN-based methods treat segmentation as a pixel-wise classification problem. However, three unique problems of cell images adversely affect segmentation accuracy: lack of established training dataset, few pixels on cell boundaries, and ubiquitous blurry features. The problem becomes especially severe with densely packed cells, where a pixel-wise classification method tends to identify two neighboring cells with blurry shared boundary as one cell, leading to poor cell count accuracy and affecting subsequent analysis. Here we developed a different learning strategy that combines strengths of CNN and watershed algorithm. The method first trains a CNN to learn Euclidean distance transform of binary masks corresponding to the input images. Then another CNN is trained to detect individual cells in the Euclidean distance transform. In the third step, the watershed algorithm takes the outputs from the previous steps as inputs and performs the segmentation. We tested the combined method and various forms of the pixel-wise classification algorithm on segmenting fluorescence and transmitted light images. The new method achieves similar pixel accuracy but significant higher cell count accuracy than pixel-wise classification methods do, and the advantage is most obvious when applying on noisy images of densely packed cells.

Quantitative Methods
An Improved Nested U-Net Network for Fluorescence In Situ Hybridization Cell Image Segmentation

Zini Jian,Tianxiang Song,Zhihui Zhang,Zhao Ai,Heng Zhao,Man Tang,Kan Liu

DOI: https://doi.org/10.3390/s24030928

IF: 3.9

2024-02-01

Sensors

Abstract:Fluorescence in situ hybridization (FISH) is a powerful cytogenetic method used to precisely detect and localize nucleic acid sequences. This technique is proving to be an invaluable tool in medical diagnostics and has made significant contributions to biology and the life sciences. However, the number of cells is large and the nucleic acid sequences are disorganized in the FISH images taken using the microscope. Processing and analyzing images is a time-consuming and laborious task for researchers, as it can easily tire the human eyes and lead to errors in judgment. In recent years, deep learning has made significant progress in the field of medical imaging, especially the successful application of introducing the attention mechanism. The attention mechanism, as a key component of deep learning, improves the understanding and interpretation of medical images by giving different weights to different regions of the image, enabling the model to focus more on important features. To address the challenges in FISH image analysis, we combined medical imaging with deep learning to develop the SEAM-Unet++ automated cell contour segmentation algorithm with integrated attention mechanism. The significant advantage of this algorithm is that it improves the accuracy of cell contours in FISH images. Experiments have demonstrated that by introducing the attention mechanism, our method is able to segment cells that are adherent to each other more efficiently.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learning

Zhuchen Shao,Sourya Sengupta,Hua Li,Mark A. Anastasio

2023-08-09

Abstract:Automated semantic segmentation of cell nuclei in microscopic images is crucial for disease diagnosis and tissue microenvironment analysis. Nonetheless, this task presents challenges due to the complexity and heterogeneity of cells. While supervised deep learning methods are promising, they necessitate large annotated datasets that are time-consuming and error-prone to acquire. Semi-supervised approaches could provide feasible alternatives to this issue. However, the limited annotated data may lead to subpar performance of semi-supervised methods, regardless of the abundance of unlabeled data. In this paper, we introduce a novel unsupervised pre-training-based semi-supervised framework for cell-nuclei segmentation. Our framework is comprised of three main components. Firstly, we pretrain a diffusion model on a large-scale unlabeled dataset. The diffusion model's explicit modeling capability facilitates the learning of semantic feature representation from the unlabeled data. Secondly, we achieve semantic feature aggregation using a transformer-based decoder, where the pretrained diffusion model acts as the feature extractor, enabling us to fully utilize the small amount of labeled data. Finally, we implement a collaborative learning framework between the diffusion-based segmentation model and a supervised segmentation model to further enhance segmentation performance. Experiments were conducted on four publicly available datasets to demonstrate significant improvements compared to competitive semi-supervised segmentation methods and supervised baselines. A series of out-of-distribution tests further confirmed the generality of our framework. Furthermore, thorough ablation experiments and visual analysis confirmed the superiority of our proposed method.

Image and Video Processing
An Integrative Segmentation Framework for Cell Nucleus of Fluorescence Microscopy

Weihao Pan,Zhe Liu,Weichen Song,Xuyang Zhen,Kai Yuan,Fei Xu,Guan Ning Lin

DOI: https://doi.org/10.3390/genes13030431

IF: 4.141

2022-02-26

Genes

Abstract:Nucleus segmentation of fluorescence microscopy is a critical step in quantifying measurements in cell biology. Automatic and accurate nucleus segmentation has powerful applications in analyzing intrinsic characterization in nucleus morphology. However, existing methods have limited capacity to perform accurate segmentation in challenging samples, such as noisy images and clumped nuclei. In this paper, inspired by the idea of cascaded U-Net (or W-Net) and its remarkable performance improvement in medical image segmentation, we proposed a novel framework called Attention-enhanced Simplified W-Net (ASW-Net), in which a cascade-like structure with between-net connections was used. Results showed that this lightweight model could reach remarkable segmentation performance in the BBBC039 testing set (aggregated Jaccard index, 0.90). In addition, our proposed framework performed better than the state-of-the-art methods in terms of segmentation performance. Moreover, we further explored the effectiveness of our designed network by visualizing the deep features from the network. Notably, our proposed framework is open source.

genetics & heredity
DSCA-Net: Double-stage Codec Attention Network for automatic nuclear segmentation

Zhiwei Ye,Bin Hu,Haigang Sui,Mengqing Mei,Liye Mei,Ran Zhou

DOI: https://doi.org/10.1016/j.bspc.2023.105569

IF: 5.1

2023-10-15

Biomedical Signal Processing and Control

Abstract:The rapid and precise segmentation of cell nuclei from hematoxylin and eosin-stained tissue images is an essential clinical undertaking with significant implications for various clinical applications. The segmentation of cell nuclei poses specific challenges due to the inherent instability of nuclear morphology and the complexity of the segmentation environments. Furthermore, previous studies have primarily relied on small-scale and limited-diverse datasets, potentially hindering their applicability to clinical tasks. This study introduces a novel approach, the Double-stage Codec Attention Network, designed to automatically and accurately segment nuclei. Specifically, we present a hierarchical feature extraction module, which maximizes the utilization of cell nuclei's morphological characteristics in the tissue, thereby providing critical semantic information for nucleus segmentation. Furthermore, the feature selection units are employed to enhance relevant features and suppress interfering ones, thereby enhancing the overall expressive capacity of the information. The multi-scale deep feature fusion module utilizes interrelated encoder–decoder connections to jointly optimize and integrate this information, generating a robust hierarchical feature pyramid. Finally, the feature attention fusion mechanism captures spatial and directional information, aiding the model in the accurate localization and recognition of cell nuclei. We rigorously evaluated our proposed method using the PanNuke dataset, the largest comprehensive histology dataset of cancer tissues. In terms of the average F1-score across all segmentation classes in the PanNuke dataset, DSCA-Net outperforms other state-of-the-art models such as DeepLabV3+, TransUNet, Triple U-net, and TransNuSeg by 1.38, 1.44, 2.64, and 1.02, respectively. Additionally, DSCA-Net shows excellent efficiency in generating predictive images, outperforming all comparative models.

engineering, biomedical

Exploring the Knowledge of Human Expert beyond His Willing Expression

Evaluation Of Deep Learning Strategies For Nucleus Segmentation In Fluorescence Images

Mutual-Complementing Framework for Nuclei Detection and Segmentation in Pathology Image

aiSEGcell: User-friendly deep learning-based segmentation of nuclei in transmitted light images

A deep learning algorithm for one-step contour aware nuclei segmentation of histopathology images

Deep Learning Model for Cell Nuclei Segmentation and Lymphocyte Identification in Whole Slide Histology Images

Enhancing Multi-tissue and Multi-scale Cell Nuclei Segmentation with Deep Metric Learning

Deep Learning architectures for generalized immunofluorescence based nuclear image segmentation

Efficient Multi-Organ Multi-Center Cell Nuclei Segmentation Method Based on Deep Learnable Aggregation Network

Deep Learning-driven Automatic Nuclei Segmentation of Label-free Live Cell Chromatin-sensitive Partial Wave Spectroscopic Microscopy Imaging

Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images

Propanil (3,4-dichloropropionanilide)-induced methemoglobin formation in mice in relation to acylamidase activity.

Diffusion-based Data Augmentation for Nuclei Image Segmentation

Nucleus segmentation from the histopathological images of liver cancer through an efficient deep learning framework

Learn to segment single cells with deep distance estimator and deep cell detector

An Improved Nested U-Net Network for Fluorescence In Situ Hybridization Cell Image Segmentation

Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learning

An Integrative Segmentation Framework for Cell Nucleus of Fluorescence Microscopy

DSCA-Net: Double-stage Codec Attention Network for automatic nuclear segmentation