Abstract:Colony-Forming Unit (CFU) counting is a complex problem without a universal solution in biomedical and food safety domains. A multitude of sophisticated heuristics and segmentation-driven approaches have been proposed by researchers. However, U-Net remains the most frequently cited and used deep learning method in these domains. The latter approach provides a segmentation output map and requires an additional counting procedure to calculate unique segmented regions and detect microbial colonies. However, due to pixel-based targets, it tends to generate irrelevant artifacts or errant pixels, leading to inaccurate and mixed post-processing results. In response to these challenges, this paper proposes a novel hybrid counting approach, incorporating a multi-loss U-Net reformulation and a post-processing Petri dish localization algorithm. Firstly, a unique innovation lies in the multi-loss U-Net reformulation. An additional loss term is introduced in the bottleneck U-Net layer, focusing on the delivery of an auxiliary signal that indicates where to look for distinct CFUs. Secondly, the novel localization algorithm automatically incorporates an agar plate and its bezel into the CFU counting techniques. Finally, the proposition is further enhanced by the integration of a fully automated solution, which comprises a specially designed uniform Petri dish illumination system and a counting web application. The latter application directly receives images from the camera, processes them, and sends the segmentation results to the user. This feature provides an opportunity to correct the CFU counts, offering a feedback loop that contributes to the continued development of the deep learning model. Through extensive experimentation, the authors of this paper have found that all probed multi-loss U-Net architectures incorporated into the proposed hybrid approach consistently outperformed their single-loss counterparts, as well as other comparable models such as self-normalized density maps and YOLOv6, by at least 1% to 3% in mean absolute and symmetric mean absolute percentage errors. Further significant improvements were also reported through the means of the novel localization algorithm. This reaffirms the effectiveness of the proposed hybrid solution in addressing contemporary challenges of precise in vitro CFU counting.

Automated Yeast Cells Segmentation and Counting Using a Parallel U-Net Based Two-Stage Framework

U2-Net and ResNet50-Based Automatic Pipeline for Bacterial Colony Counting

Yeast cell segmentation in microstructured environments with deep learning

A computer vision and residual neural network (ResNet) combined method for automated and accurate yeast replicative aging analysis of high-throughput microfluidic single-cell images

Automatic Yeast Detection and Counting Using Computer Vision Techniques

Automatic Cell Counting in Flourescent Microscopy Using Deep Learning

Hybrid Approach to Colony-Forming Unit Counting Problem Using Multi-Loss U-Net Reformulation

Plating and imaging of yeast colonies for segmentation and classification with neural networks

An Automatic Method for Robust and Fast Cell Detection in Bright Field Images from High-Throughput Microscopy.

Multiclass Yeast Segmentation in Microstructured Environments with Deep Learning

A Method of Automatic Cell Counting Based on Microscopic Image

Auto-CSC: A Transfer Learning Based Automatic Cell Segmentation and Count Framework

Yeast cell detection using fuzzy automatic contrast enhancement (FACE) and you only look once (YOLO)

fastER: a user-friendly tool for ultrafast and robust cell segmentation in large-scale microscopy.

Yeast Concentration Analysis by Using the Portable Microscope Based on the Fiber-Optic Array

An experimental setup and segmentation method for CFU counting on agar plate for the assessment of drinking water

Analysis of the performance of U-Net neural networks for the segmentation of living cells

Saliency and boundary guided segmentation framework for cell counting in microscopy images

A systematic evaluation of computational methods for cell segmentation

Hybrid machine-learning framework for volumetric segmentation and quantification of vacuoles in individual yeast cells using holotomography