Zum Verhalten der Nucleotide und ihrer dephosphorylierten Abbauprodukte in der Niere während und nach Ischämie

B. Deuticke,E. Gerlach

DOI: https://doi.org/10.1007/BF00672556

Abstract:

What problem does this paper attempt to address?

Joint Feature Learning for Cell Segmentation Based on Multi-scale Convolutional U-Net.

Zhichao Jin,Haigen Hu,Qianwei Zhou,Qiu Guan,Xiaoxin Li,Qi Chen

DOI: https://doi.org/10.1109/bibm55620.2022.9995235

2022-01-01

Abstract:A major challenge in the analysis of tissue imaging data is cell segmentation, the task of identifying precisely the boundary of each cell in a microscopic image. The cell segmentation task is still challenging due to the variable shapes, large size differences, uneven grayscale, and dense distribution of biological cells in microscopic images. In this paper, we propose a joint feature learning method that integrates the density and boundary branch into a multi-scale convolutional U-Net (MC-Unet). To enhance the supervision of cell density and boundary detection, the density and boundary loss is constructed to guide the joint learning of multiple features, where the density loss branch can address the challenges posed by high density, while the boundary loss branch can address the problems of unclear cell boundaries and partial cell occlusion. A series of experiments on different cell datasets show that two auxiliary branches improve the learning of features on cell density and cell boundaries and that the proposed method is effective on different segmentation models. The code is available at: https://github.com/HuHaigen/Joint-Feature-Learning-for-Cell-Segmentation.
Efficient Multi-Organ Multi-Center Cell Nuclei Segmentation Method Based on Deep Learnable Aggregation Network

Loay Hassan,Adel Saleh,Mohamed Abdel-Nasser,Osama A. Omer,Domenec Puig

DOI: https://doi.org/10.18280/ts.380312

IF: 2.299

2021-06-30

Traitement du signal

Abstract:Automated cell nuclei delineation in whole-slide imaging (WSI) is a fundamental step for many tasks like cancer cell recognition, cancer grading, and cancer subtype classification. Although numerous computational methods have been proposed for segmenting nuclei in WSI images based on image processing and deep learning, existing approaches face major challenges such as color variation due to the use of different stains, the various structures of cell nuclei, and the overlapping and clumped cell nuclei. To circumvent these challenges in this article, we propose an efficient and accurate cell nuclei segmentation method based on deep learning, in which a set of accurate individual cell nuclei segmentation models are developed to predict rough segmentation masks, and then a learnable aggregation network (LANet) is used to predict the final nuclei masks. Besides, we develop cell nuclei segmentation software (with a graphical user interface—GUI) that includes the proposed method and other deep-learning-based cell nuclei segmentation methods. A challenging WSI dataset collected from different centers and organs is used to demonstrate the efficiency of our method. The experimental results reveal that our method obtains a competitive performance compared to the existing approaches in terms of the aggregated Jaccard index (AJI=89.25%) and F1-score (F1=73.02%). The developed nuclei segmentation software can be downloaded from https://github.com/loaysh2010/Cell-Nuclei-Segmentation-GUI-Application.

computer science, artificial intelligence,engineering, electrical & electronic
Unsupervised cervical cell instance segmentation method integrating cellular characteristics

Yining Xie,Jingling Gao,Xueyan Bi,Jing Zhao

DOI: https://doi.org/10.1007/s11517-024-03222-9

2024-11-06

Medical & Biological Engineering & Computing

Abstract:Cell instance segmentation is a key technology for cervical cancer auxiliary diagnosis systems. However, pixel-level annotation is time-consuming and labor-intensive, making it difficult to obtain a large amount of annotated data. This results in the model not being fully trained. In response to these problems, this paper proposes an unsupervised cervical cell instance segmentation method that integrates cell characteristics. Cervical cells have a clear corresponding structure between the nucleus and cytoplasm. This method fully takes this feature into account by building a dual-flow framework to locate the nucleus and cytoplasm and generate high-quality pseudo-labels. In the nucleus segmentation stage, the position and range of the nucleus are determined using the standard cell-restricted nucleus segmentation method. In the cytoplasm segmentation stage, a multi-angle collaborative segmentation method is used to achieve the positioning of the cytoplasm. First, taking advantage of the self-similarity characteristics of pixel blocks in cells, a cytoplasmic segmentation method based on self-similarity map iteration is proposed. The pixel blocks are mapped from the perspective of local details, and the iterative segmentation is repeated. Secondly, using low-level features such as cell color and shape, a self-supervised heatmap-aware cytoplasm segmentation method is proposed to obtain the activation map of the cytoplasm from the perspective of global attention. The two methods are fused to determine cytoplasmic regions, and combined with nuclear locations, high-quality pseudo-labels are generated. These pseudo-labels are used to train the model cyclically, and the loss strategy is used to encourage the model to discover new object masks, thereby obtaining a segmentation model with better performance. Experimental results show that this method achieves good results in cytoplasm segmentation. On the three datasets of ISBI, MS_CellSeg, and Cx22, 54.32%, 44.64%, and 66.52% AJI were obtained, respectively, which is better than other typical unsupervised methods selected in this article.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,medical informatics
A three in one bottom-up framework for simultaneous semantic segmentation, instance segmentation and classification of multi-organ nuclei in digital cancer histology

Ibtihaj Ahmad,Syed Muhammad Israr,Zain Ul Islam

DOI: https://doi.org/10.1016/j.imavis.2024.105047

2023-08-22

Abstract:Simultaneous segmentation and classification of nuclei in digital histology play an essential role in computer-assisted cancer diagnosis; however, it remains challenging. The highest achieved binary and multi-class Panoptic Quality (PQ) remains as low as 0.68 bPQ and 0.49 mPQ, respectively. It is due to the higher staining variability, variability across the tissue, rough clinical conditions, overlapping nuclei, and nuclear class imbalance. The generic deep-learning methods usually rely on end-to-end models, which fail to address these problems associated explicitly with digital histology. In our previous work, DAN-NucNet, we resolved these issues for semantic segmentation with an end-to-end model. This work extends our previous model to simultaneous instance segmentation and classification. We introduce additional decoder heads with independent weighted losses, which produce semantic segmentation, edge proposals, and classification maps. We use the outputs from the three-head model to apply post-processing to produce the final segmentation and classification. Our multi-stage approach utilizes edge proposals and semantic segmentations compared to direct segmentation and classification strategies followed by most state-of-the-art methods. Due to this, we demonstrate a significant performance improvement in producing high-quality instance segmentation and nuclei classification. We have achieved a 0.841 Dice score for semantic segmentation, 0.713 bPQ scores for instance segmentation, and 0.633 mPQ for nuclei classification. Our proposed framework is generalized across 19 types of tissues. Furthermore, the framework is less complex compared to the state-of-the-art.

Computer Vision and Pattern Recognition,Machine Learning
A hybrid approach of simultaneous segmentation and classification for medical image analysis

DOI: https://doi.org/10.1007/s11042-024-19310-9

IF: 2.577

2024-05-17

Multimedia Tools and Applications

Abstract:Medical image analysis is a crucial step required for accurate disease diagnosis, treatment planning, and condition monitoring. In recent years, the field has undergone a groundbreaking transformation due to the advancement in artificial intelligence (AI) and deep learning (DL). These cutting-edge developments have particularly revolutionized automated segmentation and classification tasks, making them more efficient and reliable. The simultaneous performance of segmentation and classification enables the AI model to identify and isolate regions of interest, thereby enhancing the accuracy of the classification process. Several research reports showed that this simultaneous optimization posed a significant challenge, particularly in medical image analysis, of capturing intricate details and complex structures and having mitigating issues, such as vanishing gradient, distracting information, and multi-scale context. Therefore, this study proposed a hybrid hierarchical approach, SSC (Simultaneous Segmentation and Classification), integrating image segmentation and classification tasks within a redesigned network architecture. The main contribution of the study was the combination of the UNet architecture, classification block (C ), residual block, attention mechanism, and Atrous Spatial Pyramid Pooling (ASPP) block together to achieve the improvement of segmentation and classification. A thorough comparative analysis and performance evaluation on two benchmark datasets, namely COVID-19 Radiography (CoR) and Breast Ultrasound Images (BUSI), were also conducted with 5-fold cross-validation. The experimental results showed that the proposed SSC model outperformed the baseline models. For the CoR dataset, the segmentation accuracy, Dice, IoU, classification accuracy, Recall, and Precision increased by 1.16%, 1.68%, 3.11%, 0.61%, 1.11%, and 1.20%, respectively. Meanwhile, for the BUSI dataset, 3.98%, 1.09%, 8.21%, 0.20%, 4.72%, and 1.55% increments were observed in the segmentation accuracy, Dice, IoU, classification accuracy, Recall, and Precision, respectively. These results showed the proposed method's efficiency and potential for advancing simultaneous segmentation and classification tasks in medical image analysis.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Segmentation of Drug-Treated Cell Image and Mitochondrial-Oxidative Stress Using Deep Convolutional Neural Network

Awais Khan Nawabi,Sheng Jinfang,Rashid Abbasi,Muhammad Shahid Iqbal,Faijan Akhtar,Kaishun Wu,Baidenger Agyekum Twumasi,Md Belal Bin Heyat

DOI: https://doi.org/10.1155/2022/5641727

2022-05-27

Oxidative Medicine and Cellular Longevity

Abstract:Most multicellular organisms require apoptosis, or programmed cell death, to function properly and survive. On the other hand, morphological and biochemical characteristics of apoptosis have remained remarkably consistent throughout evolution. Apoptosis is thought to have at least three functionally distinct phases: induction, effector, and execution. Recent studies have revealed that reactive oxygen species (ROS) and the oxidative stress could play an essential role in apoptosis. Advanced microscopic imaging techniques allow biologists to acquire an extensive amount of cell images within a matter of minutes which rule out the manual analysis of image data acquisition. The segmentation of cell images is often considered the cornerstone and central problem for image analysis. Currently, the issue of segmentation of mitochondrial cell images via deep learning receives increasing attention. The manual labeling of cell images is time-consuming and challenging to train a pro. As a courtesy method, mitochondrial cell imaging (MCI) is proposed to identify the normal, drug-treated, and diseased cells. Furthermore, cell movement (fission and fusion) is measured to evaluate disease risk. The newly proposed drug-treated, normal, and diseased image segmentation (DNDIS) algorithm can quickly segment mitochondrial cell images without supervision and further segment the highly drug-treated cells in the picture, i.e., normal, diseased, and drug-treated cells. The proposed method is based on the ResNet-50 deep learning algorithm. The dataset consists of 414 images mainly categorised into different sets (drug, diseased, and normal) used microscopically. The proposed automated segmentation method has outperformed and secured high precision (90%, 92%, and 94%); moreover, it also achieves proper training. This study will benefit medicines and diseased cell measurements in medical tests and clinical practices.

cell biology
Conceptualizing, Creating, & Controlling Constructive and Controversial Comments: A CSCW Research-athon

Eric Gilbert,Cliff Lampe,Alex Leavitt,Katherine Lo,L. Yarosh

DOI: https://doi.org/10.1145/3022198.3022663

2017-02-25

Abstract:Many social media platforms provide features for commenting, which often provide affordances for people to give feedback to others. Around the theme of advancing research about online comments, this workshop aims to bring together a diverse range of researchers for cross-discipline community building and especially dedicated time for productive, early mixed-methods research. The workshop is structured around a research "hackathon," where participants actively work on producing initial stages of research, theory, and design related to a central dataset (in the case of this workshop, public comments from a historical reddit.com corpus). Participants will form collaborative teams to tackle questions of interest that move forward current thinking around online comment behaviors, participants, quality, and design. The one-day workshop is led by 5 researchers, and it will accommodate up to 32 participants.
An Improved Nested U-Net Network for Fluorescence In Situ Hybridization Cell Image Segmentation

Zini Jian,Tianxiang Song,Zhihui Zhang,Zhao Ai,Heng Zhao,Man Tang,Kan Liu

DOI: https://doi.org/10.3390/s24030928

IF: 3.9

2024-02-01

Sensors

Abstract:Fluorescence in situ hybridization (FISH) is a powerful cytogenetic method used to precisely detect and localize nucleic acid sequences. This technique is proving to be an invaluable tool in medical diagnostics and has made significant contributions to biology and the life sciences. However, the number of cells is large and the nucleic acid sequences are disorganized in the FISH images taken using the microscope. Processing and analyzing images is a time-consuming and laborious task for researchers, as it can easily tire the human eyes and lead to errors in judgment. In recent years, deep learning has made significant progress in the field of medical imaging, especially the successful application of introducing the attention mechanism. The attention mechanism, as a key component of deep learning, improves the understanding and interpretation of medical images by giving different weights to different regions of the image, enabling the model to focus more on important features. To address the challenges in FISH image analysis, we combined medical imaging with deep learning to develop the SEAM-Unet++ automated cell contour segmentation algorithm with integrated attention mechanism. The significant advantage of this algorithm is that it improves the accuracy of cell contours in FISH images. Experiments have demonstrated that by introducing the attention mechanism, our method is able to segment cells that are adherent to each other more efficiently.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Improved Segmentation of Cellular Nuclei Using UNET Architectures for Enhanced Pathology Imaging

Simão Castro,Vitor Pereira,Rui Silva

DOI: https://doi.org/10.3390/electronics13163335

IF: 2.9

2024-08-24

Electronics

Abstract:Medical imaging is essential for pathology diagnosis and treatment, enhancing decision making and reducing costs, but despite various computational methodologies proposed to improve imaging modalities, further optimization is needed for broader acceptance. This study explores deep learning (DL) methodologies for classifying and segmenting pathological imaging data, optimizing models to accurately predict and generalize from training to new data. Different CNN and U-Net architectures are implemented for segmentation tasks, with their performance evaluated on histological image datasets using enhanced pre-processing techniques such as resizing, normalization, and data augmentation. These are trained, parameterized, and optimized using metrics such as accuracy, the DICE coefficient, and intersection over union (IoU). The experimental results show that the proposed method improves the efficiency of cell segmentation compared to networks, such as U-NET and W-UNET. The results show that the proposed pre-processing has improved the IoU from 0.9077 to 0.9675, about 7% better results; also, the values of the DICE coefficient obtained improved from 0.9215 to 0.9916, about 7% better results, surpassing the results reported in the literature.

engineering, electrical & electronic,computer science, information systems,physics, applied
Channel Boosted CNN-Transformer-based Multi-Level and Multi-Scale Nuclei Segmentation

Zunaira Rauf,Abdul Rehman Khan,Asifullah Khan

2024-07-27

Abstract:Accurate nuclei segmentation is an essential foundation for various applications in computational pathology, including cancer diagnosis and treatment planning. Even slight variations in nuclei representations can significantly impact these downstream tasks. However, achieving accurate segmentation remains challenging due to factors like clustered nuclei, high intra-class variability in size and shape, resemblance to other cells, and color or contrast variations between nuclei and background. Despite the extensive utilization of Convolutional Neural Networks (CNNs) in medical image segmentation, they may have trouble capturing long-range dependencies crucial for accurate nuclei delineation. Transformers address this limitation but might miss essential low-level features. To overcome these limitations, we utilized CNN-Transformer-based techniques for nuclei segmentation in H&E stained histology images. In this work, we proposed two CNN-Transformer architectures, Nuclei Hybrid Vision Transformer (NucleiHVT) and Channel Boosted Nuclei Hybrid Vision Transformer (CB-NucleiHVT), that leverage the strengths of both CNNs and Transformers to effectively learn nuclei boundaries in multi-organ histology images. The first architecture, NucleiHVT is inspired by the UNet architecture and incorporates the dual attention mechanism to capture both multi-level and multi-scale context effectively. The CB-NucleiHVT network, on the other hand, utilizes the concept of channel boosting to learn diverse feature spaces, enhancing the model's ability to distinguish subtle variations in nuclei characteristics. Detailed evaluation of two medical image segmentation datasets shows that the proposed architectures outperform existing CNN-based, Transformer-based, and hybrid methods. The proposed networks demonstrated effective results both in terms of quantitative metrics, and qualitative visual assessment.

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition
Symmetry Breaking in the U-Net: Hybrid Deep-Learning Multi-Class Segmentation of HeLa Cells in Reflected Light Microscopy Images

Ali Ghaznavi,Renata Rychtáriková,Petr Císař,Mohammad Mehdi Ziaei,Dalibor Štys

DOI: https://doi.org/10.3390/sym16020227

2024-02-14

Symmetry

Abstract:Multi-class segmentation of unlabelled living cells in time-lapse light microscopy images is challenging due to the temporal behaviour and changes in cell life cycles and the complexity of these images. The deep-learning-based methods achieved promising outcomes and remarkable success in single- and multi-class medical and microscopy image segmentation. The main objective of this study is to develop a hybrid deep-learning-based categorical segmentation and classification method for living HeLa cells in reflected light microscopy images. A symmetric simple U-Net and three asymmetric hybrid convolution neural networks—VGG19-U-Net, Inception-U-Net, and ResNet34-U-Net—were proposed and mutually compared to find the most suitable architecture for multi-class segmentation of our datasets. The inception module in the Inception-U-Net contained kernels with different sizes within the same layer to extract all feature descriptors. The series of residual blocks with the skip connections in each ResNet34-U-Net's level alleviated the gradient vanishing problem and improved the generalisation ability. The m-IoU scores of multi-class segmentation for our datasets reached 0.7062, 0.7178, 0.7907, and 0.8067 for the simple U-Net, VGG19-U-Net, Inception-U-Net, and ResNet34-U-Net, respectively. For each class and the mean value across all classes, the most accurate multi-class semantic segmentation was achieved using the ResNet34-U-Net architecture (evaluated as the m-IoU and Dice metrics).

multidisciplinary sciences
Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

Xuping Huang,Qian Wang,Junxi Chen,Lingna Chen,Zhiyi Chen

DOI: https://doi.org/10.1016/j.imavis.2023.104742

IF: 3.86

2023-06-21

Image and Vision Computing

Abstract:Ultrasound image segmentation plays a vital role in the early diagnosis of human diseases. It helps diagnose many diseases, such as breast cancer, hemangioma, and other gynecological disorders. However, the intrinsic imaging characteristics of ultrasound images result in substantially lower resolution and clarity than CT, MRI, and other imaging modalities, and they are sensitive to interference from external influences. With its inherent artifacts, blurred lesion boundaries, and uneven intensity distribution, ultrasound images present a challenging task when it comes to segmenting lesion areas accurately. In recent years, convolutional neural networks (CNNs) have achieved remarkable results in medical image segmentation tasks. However, CNNs are limited in capturing the remote dependencies of the input image, leading to degraded accuracy in segmenting ultrasound lesions. In this paper, we developed a deep convolutional neural network that incorporates the pseudo-color enhancement algorithm and hybrid attention modules that enhance the network's ability to extract fine features and remote modeling capabilities. We propose a novel multi-scale channel attention-based decoder that efficiently uses the feature maps from the encoder as a complement and fuses them with the upsampled feature maps. The hybrid attention combination captures cross-channel interactions efficiently and enhances the context modeling capability, further improving the extraction of coarse and delicate features, and resulting in significant performance improvements. We found that the dice performance improved by 2.54%, 2.47%, 1.39%, 0.99%, and 1.23% on the BUL, BUSI, Hemangioma, BP, and VUI. Results from four public datasets and one self-collected dataset indicate that the proposed method outperforms other medical image segmentation methods for ultrasound image lesion segmentation.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, software engineering,optics
Improved U-net-based leukocyte segmentation method

Mengjing Zhu,Wei Chen,Yi Sun,Zhaohui Li

DOI: https://doi.org/10.1117/1.jbo.28.4.045002

IF: 3.758

2023-04-12

Journal of Biomedical Optics

Abstract:Significance: Leukocytes are mainly composed of neutrophils, basophils, eosinophils, monocytes, and lymphocytes. The number and proportion of different types of leukocytes correspond to different diseases, so an accurate segmentation of each type of leukocyte is important for the diagnosis of disease. However, the acquisition of blood cell images can be affected by external environmental factors, which can lead to variable light and darkness, complex backgrounds, and poorly characterized leukocytes.Aim: To address the problem of complex blood cell images collected under different environments and the lack of obvious leukocyte features, a leukocyte segmentation method based on improved U-net is proposed.Approach: First, adaptive histogram equalization-retinex correction was introduced for data enhancement to make the leukocyte features in the blood cell images clearer. Then, to address the problem of similarity between different types of leukocytes, convolutional block attention module is added to the four skip connections of U-net to focus the features from spatial and channel aspects, so that the network can quickly locate the high-value information of features in different channels and spaces. It avoids the problem of large amount of repeated computation of low-value information, prevents overfitting, and improves the training efficiency and generalization ability of the network. Finally, to solve the problem of class imbalance in blood cell images and to better segment the cytoplasm of leukocytes, a loss function combining focal loss and Dice loss is proposed.Results: We use the BCISC public dataset to verify the effectiveness of the proposed method. The segmentation of multiple leukocytes using the method of this paper can achieve 99.53% accuracy and 91.89% mIoU.Conclusions: The experimental results show that the method achieves good segmentation results for lymphocytes, basophils, neutrophils, eosinophils, and monocytes.

radiology, nuclear medicine & medical imaging,biochemical research methods,optics
A Heteromorphous Deep CNN Framework for Medical Image Segmentation Using Local Binary Pattern

Saeed Iqbal,Adnan N. Qureshi

DOI: https://doi.org/10.1109/access.2022.3183331

IF: 3.9

2022-06-21

IEEE Access

Abstract:Estimating mitotic nuclei in breast cancer samples can aid in determining the tumor's aggressiveness and grading system. Because of their strong resemblance to non-mitotic nuclei and heteromorphic form, automated evaluation of mitotic nuclei is difficult. This study presents the BreastUNet, a new heteromorphous Deep Convolutional Neural Network (CNN) with feature grafting approach for analysing mitotic nuclei in breast histopathology images. In the first stage, the proposed method identifies probable mitotic patches in histopathological imaging regions, and in the second stage, the proposed model classifies these patches into mitotic and non-mitotic nuclei. For the building of a heteromorphous deep CNN, four distinct deep CNNs are developed and used as the basis CNN model. Deep CNNs with various architectural designs capture the structural, textural, and morphological aspects of mitotic nuclei. The performance of the proposed BreastUNet model is compared to those of state-of-the-art CNNs. The proposed model looks superior on the test set, with an F1 score of 0.95, Sensitivity and Specificity is 0.95 and area under the precision curve of 0.95. The recommended hybrid high F1 score and precision, as well as its excellent generalization and accuracy, imply that it might be used to build a pathologist's aid tool.

computer science, information systems,telecommunications,engineering, electrical & electronic
CH-Net: A Cross Hybrid Network for Medical Image Segmentation

Jiale Li,Aiping Liu,Wei,Ruobing Qian,Xun Chen

DOI: https://doi.org/10.1109/tai.2024.3503541

2024-01-01

IEEE Transactions on Artificial Intelligence

Abstract:Accurate and automated segmentation of medical images plays a crucial role in diagnostic evaluation and treatment planning. In recent years, hybrid models have gained considerable popularity in diverse medical image segmentation tasks, as they leverage the benefits of both convolution and self-attention to capture local and global dependencies simultaneously. However, most existing hybrid models treat convolution and self-attention as independent components and integrate them using simple fusion methods, neglecting the potential complementary information between their weight allocation mechanisms. To address this issue, we propose a Cross Hybrid Network (CHNet) for medical image segmentation, in which convolution and self-attention are hybridized in a cross-collaborative manner. Specifically, we introduce a Cross Hybrid Module between the parallel convolution layer and self-attention layer in each building block of CH-Net. This module extracts attention with distinct dimensional information from convolution and self-attention, respectively, and uses this complementary information to enhance the feature representation of both components. In contrast to the traditional approach where each module learned independently, the Cross Hybrid Module facilitates the interactive learning of complementary information between convolutional layer and self-attention layer, which significantly enhances the segmentation capabilities of the model. The superiority of our approach over various hybrid models is demonstrated through experimental evaluations conducted on three publicly available benchmarks: ACDC, Synapse, and EM.
Nuclei Instance Segmentation of Cryosectioned H&E Stained Histological Images using Triple U-Net Architecture

Zarif Ahmed,Chowdhury Nur E Alam Siddiqi,Fardifa Fathmiul Alam,Tasnim Ahmed,Tareque Mohmud Chowdhury

2024-04-20

Abstract:Nuclei instance segmentation is crucial in oncological diagnosis and cancer pathology research. H&E stained images are commonly used for medical diagnosis, but pre-processing is necessary before using them for image processing tasks. Two principal pre-processing methods are formalin-fixed paraffin-embedded samples (FFPE) and frozen tissue samples (FS). While FFPE is widely used, it is time-consuming, while FS samples can be processed quickly. Analyzing H&E stained images derived from fast sample preparation, staining, and scanning can pose difficulties due to the swift process, which can result in the degradation of image quality. This paper proposes a method that leverages the unique optical characteristics of H&E stained images. A three-branch U-Net architecture has been implemented, where each branch contributes to the final segmentation results. The process includes applying watershed algorithm to separate overlapping regions and enhance accuracy. The Triple U-Net architecture comprises an RGB branch, a Hematoxylin branch, and a Segmentation branch. This study focuses on a novel dataset named CryoNuSeg. The results obtained through robust experiments outperform the state-of-the-art results across various metrics. The benchmark score for this dataset is AJI 52.5 and PQ 47.7, achieved through the implementation of U-Net Architecture. However, the proposed Triple U-Net architecture achieves an AJI score of 67.41 and PQ of 50.56. The proposed architecture improves more on AJI than other evaluation metrics, which further justifies the superiority of the Triple U-Net architecture over the baseline U-Net model, as AJI is a more strict evaluation metric. The use of the three-branch U-Net model, followed by watershed post-processing, significantly surpasses the benchmark scores, showing substantial improvement in the AJI score

Image and Video Processing,Computer Vision and Pattern Recognition
A Novel Hybridoma Cell Segmentation Method Based on Multi-Scale Feature Fusion and Dual Attention Network

Jianfeng Lu,Hangpeng Ren,Mengtao Shi,Chen Cui,Shanqing Zhang,Mahmoud Emam,Li Li

DOI: https://doi.org/10.3390/electronics12040979

IF: 2.9

2023-02-17

Electronics

Abstract:The hybridoma cell screening method is usually done manually by human eyes during the production process for monoclonal antibody drugs. This traditional screening method has certain limitations, such as low efficiency and subjectivity bias. Furthermore, most of the existing deep learning-based image segmentation methods have certain drawbacks, due to different shapes of hybridoma cells and uneven location distribution. In this paper, we propose a deep hybridoma cell image segmentation method based on residual and attention U-Net (RA-UNet). Firstly, the feature maps of the five modules in the network encoder are used for multi-scale feature fusion in a feature pyramid form and then spliced into the network decoder to enrich the semantic level of the feature maps in the decoder. Secondly, a dual attention mechanism module based on global and channel attention mechanisms is presented. The global attention mechanism (non-local neural network) is connected to the network decoder to expand the receptive field of the feature map and bring more rich information to the network. Then, the channel attention mechanism SENet (the squeeze-and-excitation network) is connected to the non-local attention mechanism. Consequently, the important features are enhanced by the learning of the feature channel weights, and the secondary features are suppressed, hence improving the cell segmentation performance and accuracy. Finally, the focal loss function is used to guide the network to learn the hard-to-classify cell categories. Furthermore, we evaluate the performance of the proposed RA-UNet method on a newly established hybridoma cell image dataset. Experimental results show that the proposed method has good reliability and improves the efficiency of hybridoma cell segmentation compared with state-of-the-art networks such as FCN, UNet, and UNet++. The results show that the proposed RA-UNet model has improvements of 0.8937%, 0.9926%, 0.9512%, and 0.9007% in terms of the dice coefficients, PA, MPA, and MIoU, respectively.

engineering, electrical & electronic,computer science, information systems,physics, applied
CellSAM: Advancing Pathologic Image Cell Segmentation via Asymmetric Large‐Scale Vision Model Feature Distillation Aggregation Network

Xiao Ma,Jin Huang,Mengping Long,Xiaoxiao Li,Zhaoyi Ye,Wanting Hu,Yaxiaer Yalikun,Du Wang,Taobo Hu,Liye Mei,Cheng Lei

DOI: https://doi.org/10.1002/jemt.24716

2024-10-25

Microscopy Research and Technique

Abstract:We propose CellSAM, a robust model for cell segmentation in medical images using a dual‐image encoder and knowledge distillation. It achieves high accuracy with limited training data, showing promise for clinical applications in disease diagnosis and treatment. Segment anything model (SAM) has attracted extensive interest as a potent large‐scale image segmentation model, with prior efforts adapting it for use in medical imaging. However, the precise segmentation of cell nucleus instances remains a formidable challenge in computational pathology, given substantial morphological variations and the dense clustering of nuclei with unclear boundaries. This study presents an innovative cell segmentation algorithm named CellSAM. CellSAM has the potential to improve the effectiveness and precision of disease identification and therapy planning. As a variant of SAM, CellSAM integrates dual‐image encoders and employs techniques such as knowledge distillation and mask fusion. This innovative model exhibits promising capabilities in capturing intricate cell structures and ensuring adaptability in resource‐constrained scenarios. The experimental results indicate that this structure effectively enhances the quality and precision of cell segmentation. Remarkably, CellSAM demonstrates outstanding results even with minimal training data. In the evaluation of particular cell segmentation tasks, extensive comparative analyzes show that CellSAM outperforms both general fundamental models and state‐of‐the‐art (SOTA) task‐specific models. Comprehensive evaluation metrics yield scores of 0.884, 0.876, and 0.768 for mean accuracy, recall, and precision respectively. Extensive experiments show that CellSAM excels in capturing subtle details and complex structures and is capable of segmenting cells in images accurately. Additionally, CellSAM demonstrates excellent performance on clinical data, indicating its potential for robust applications in treatment planning and disease diagnosis, thereby further improving the efficiency of computer‐aided medicine.

biology,microscopy,anatomy & morphology
LKCell: Efficient Cell Nuclei Instance Segmentation with Large Convolution Kernels

Ziwei Cui,Jingfeng Yao,Lunbin Zeng,Juan Yang,Wenyu Liu,Xinggang Wang

2024-07-25

Abstract:The segmentation of cell nuclei in tissue images stained with the blood dye hematoxylin and eosin (H$\&$E) is essential for various clinical applications and analyses. Due to the complex characteristics of cellular morphology, a large receptive field is considered crucial for generating high-quality segmentation. However, previous methods face challenges in achieving a balance between the receptive field and computational burden. To address this issue, we propose LKCell, a high-accuracy and efficient cell segmentation method. Its core insight lies in unleashing the potential of large convolution kernels to achieve computationally efficient large receptive fields. Specifically, (1) We transfer pre-trained large convolution kernel models to the medical domain for the first time, demonstrating their effectiveness in cell segmentation. (2) We analyze the redundancy of previous methods and design a new segmentation decoder based on large convolution kernels. It achieves higher performance while significantly reducing the number of parameters. We evaluate our method on the most challenging benchmark and achieve state-of-the-art results (0.5080 mPQ) in cell nuclei instance segmentation with only 21.6% FLOPs compared with the previous leading method. Our source code and models are available at <a class="link-external link-https" href="https://github.com/hustvl/LKCell" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition

Zum Verhalten der Nucleotide und ihrer dephosphorylierten Abbauprodukte in der Niere während und nach Ischämie

Joint Feature Learning for Cell Segmentation Based on Multi-scale Convolutional U-Net.

Efficient Multi-Organ Multi-Center Cell Nuclei Segmentation Method Based on Deep Learnable Aggregation Network

Unsupervised cervical cell instance segmentation method integrating cellular characteristics

A three in one bottom-up framework for simultaneous semantic segmentation, instance segmentation and classification of multi-organ nuclei in digital cancer histology

A hybrid approach of simultaneous segmentation and classification for medical image analysis

Segmentation of Drug-Treated Cell Image and Mitochondrial-Oxidative Stress Using Deep Convolutional Neural Network

Conceptualizing, Creating, & Controlling Constructive and Controversial Comments: A CSCW Research-athon

An Improved Nested U-Net Network for Fluorescence In Situ Hybridization Cell Image Segmentation

Improved Segmentation of Cellular Nuclei Using UNET Architectures for Enhanced Pathology Imaging

Channel Boosted CNN-Transformer-based Multi-Level and Multi-Scale Nuclei Segmentation

Symmetry Breaking in the U-Net: Hybrid Deep-Learning Multi-Class Segmentation of HeLa Cells in Reflected Light Microscopy Images

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

Improved U-net-based leukocyte segmentation method

A Heteromorphous Deep CNN Framework for Medical Image Segmentation Using Local Binary Pattern

CH-Net: A Cross Hybrid Network for Medical Image Segmentation

Nuclei Instance Segmentation of Cryosectioned H&E Stained Histological Images using Triple U-Net Architecture

A Novel Hybridoma Cell Segmentation Method Based on Multi-Scale Feature Fusion and Dual Attention Network

CellSAM: Advancing Pathologic Image Cell Segmentation via Asymmetric Large‐Scale Vision Model Feature Distillation Aggregation Network

LKCell: Efficient Cell Nuclei Instance Segmentation with Large Convolution Kernels