Automatic enhancement preprocessing for segmentation of low quality cell images

Sota Kato,Kazuhiro Hotta

DOI: https://doi.org/10.1038/s41598-024-53411-7

IF: 4.6

2024-02-15

Scientific Reports

Abstract:We present a novel automatic preprocessing and ensemble learning technique for the segmentation of low-quality cell images. Capturing cells subjected to intense light is challenging due to their vulnerability to light-induced cell death. Consequently, microscopic cell images tend to be of low quality and it causes low accuracy for semantic segmentation. This problem can not be satisfactorily solved by classical image preprocessing methods. Therefore, we propose a novel approach of automatic enhancement preprocessing (AEP), which translates an input image into images that are easy to recognize by deep learning. AEP is composed of two deep neural networks, and the penultimate feature maps of the first network are employed as filters to translate an input image with low quality into images that are easily classified by deep learning. Additionally, we propose an automatic weighted ensemble learning (AWEL), which combines the multiple segmentation results. Since the second network predicts segmentation results corresponding to each translated input image, multiple segmentation results can be aggregated by automatically determining suitable weights. Experiments on two types of cell image segmentation confirmed that AEP can translate low-quality cell images into images that are easy to segment and that segmentation accuracy improves using AWEL.

multidisciplinary sciences

What problem does this paper attempt to address?

The paper aims to address the issue of low-quality cell image segmentation. Specifically: - **Research Background**: Under intense lighting, cells are prone to death, making it very difficult to obtain high-quality cell images. This results in low-quality cell images obtained through microscopes, thereby affecting the accuracy of semantic segmentation. - **Limitations of Existing Methods**: Traditional image preprocessing methods (such as Gaussian filtering and bilateral filtering) can remove noise but are not suitable for deep learning models, and the effectiveness of these methods depends on manually adjusted hyperparameters. - **Proposed Method**: The authors propose a new Automatic Enhancement Preprocessing (AEP) method, which uses Convolutional Neural Networks (CNN) in deep learning to generate easily recognizable images. Additionally, they propose Automatic Weighted Ensemble Learning (AWEL) to combine multiple segmentation results to improve segmentation accuracy. Through experimental validation, AEP can convert low-quality cell images into images that are easier to segment, and using AWEL can further enhance segmentation accuracy. Experimental results show that the proposed methods perform better on different types of cell image datasets compared to traditional segmentation methods.

Automatic enhancement preprocessing for segmentation of low quality cell images

Automatic Preprocessing and Ensemble Learning for Low Quality Cell Image Segmentation

Joint Feature Learning for Cell Segmentation Based on Multi-scale Convolutional U-Net.

Attention-Guided Residual U-Net with SE Connection and ASPP for Watershed-Based Cell Segmentation in Microscopy Images

Learn to segment single cells with deep distance estimator and deep cell detector

Efficient end-to-end learning for cell segmentation with machine generated weak annotations

Accurate Cell Segmentation in Digital Pathology Images via Attention Enforced Networks

A General Deep Learning framework for Neuron Instance Segmentation based on Efficient UNet and Morphological Post-processing

Facilitating cell segmentation with the projection-enhancement network

Collaborative boundary-aware context encoding networks for error map prediction

Accuracy Improvement of Cell Image Segmentation Using Feedback Former

QualityNet: Segmentation Quality Evaluation with Deep Convolutional Networks.

Enforcing Morphological Information in Fully Convolutional Networks to Improve Cell Instance Segmentation in Fluorescence Microscopy Images

One-shot and Partially-Supervised Cell Image Segmentation Using Small Visual Prompt

Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation

EANet: Iterative edge attention network for medical image segmentation

An Improved Nested U-Net Network for Fluorescence In Situ Hybridization Cell Image Segmentation

Multiplexed Immunofluorescence Brain Image Analysis Using Self-Supervised Dual-Loss Adaptive Masked Autoencoder

High-resolution deep transferred ASPPU-Net for nuclei segmentation of histopathology images

EAA-Net: Rethinking the Autoencoder Architecture with Intra-class Features for Medical Image Segmentation

Two-layer Ensemble of Deep Learning Models for Medical Image Segmentation