Abstract:BackgroundColonoscopy remains the gold-standard screening for colorectal cancer. However, significant miss rates for polyps have been reported, particularly when there are multiple small adenomas. This presents an opportunity to leverage computer-aided systems to support clinicians and reduce the number of polyps missed.MethodIn this work we introduce the Focus U-Net, a novel dual attention-gated deep neural network, which combines efficient spatial and channel-based attention into a single Focus Gate module to encourage selective learning of polyp features. The Focus U-Net incorporates several further architectural modifications, including the addition of short-range skip connections and deep supervision. Furthermore, we introduce the Hybrid Focal loss, a new compound loss function based on the Focal loss and Focal Tversky loss, designed to handle class-imbalanced image segmentation. For our experiments, we selected five public datasets containing images of polyps obtained during optical colonoscopy: CVC-ClinicDB, Kvasir-SEG, CVC-ColonDB, ETIS-Larib PolypDB and EndoScene test set. We first perform a series of ablation studies and then evaluate the Focus U-Net on the CVC-ClinicDB and Kvasir-SEG datasets separately, and on a combined dataset of all five public datasets. To evaluate model performance, we use the Dice similarity coefficient (DSC) and Intersection over Union (IoU) metrics.ResultsOur model achieves state-of-the-art results for both CVC-ClinicDB and Kvasir-SEG, with a mean DSC of 0.941 and 0.910, respectively. When evaluated on a combination of five public polyp datasets, our model similarly achieves state-of-the-art results with a mean DSC of 0.878 and mean IoU of 0.809, a 14% and 15% improvement over the previous state-of-the-art results of 0.768 and 0.702, respectively.ConclusionsThis study shows the potential for deep learning to provide fast and accurate polyp segmentation results for use during colonoscopy. The Focus U-Net may be adapted for future use in newer non-invasive colorectal cancer screening and more broadly to other biomedical image segmentation tasks similarly involving class imbalance and requiring efficiency.

AG-CUResNeSt: A Novel Method for Colon Polyp Segmentation

Automatic Polyp Segmentation Using Convolutional Neural Networks

Polyp Segmentation in Colonoscopy Images using U-Net-MobileNetV2

CRPU-NET: a deep learning model based semantic segmentation for the detection of colorectal polyp in lower gastrointestinal tract

M3ResU-Net: a Deep Residual Network for Multi-Center Colorectal Polyp Segmentation Based on Multi-Scale Learning and Attention Mechanism.

TransResU-Net: Transformer based ResU-Net for Real-Time Colonoscopy Polyp Segmentation

A Comprehensive Study on Colorectal Polyp Segmentation with ResUNet++, Conditional Random Field and Test-Time Augmentation

TransResU-Net: A Transformer based ResU-Net for Real-Time Colon Polyp Segmentation

An approach of polyp segmentation from colonoscopy images using Dilated-U-Net-Seg – A deep learning network

Focus U-Net: A novel dual attention-gated CNN for polyp segmentation during colonoscopy

Multi Kernel Positional Embedding ConvNeXt for Polyp Segmentation

Colorectal Polyp Segmentation by U-Net with Dilation Convolution

CMNet: deep learning model for colon polyp segmentation based on dual-branch structure

Dual-branch multi-information aggregation network with transformer and convolution for polyp segmentation

Parallel Res2Net-based Network with ReverseAttention for Polyp Segmentation.

ECTransNet: An Automatic Polyp Segmentation Network Based on Multi-scale Edge Complementary

Colorectal Polyp Segmentation Based on Group Convolution and Transformer

Multi‐scale nested UNet with transformer for colorectal polyp segmentation

Automatic Polyp Segmentation in Colonoscopy Images Using a Modified Deep Convolutional Encoder-Decoder Architecture

SSN: A Stair-Shape Network for Real-Time Polyp Segmentation in Colonoscopy Images.