Abstract:BackgroundColonoscopy remains the gold-standard screening for colorectal cancer. However, significant miss rates for polyps have been reported, particularly when there are multiple small adenomas. This presents an opportunity to leverage computer-aided systems to support clinicians and reduce the number of polyps missed.MethodIn this work we introduce the Focus U-Net, a novel dual attention-gated deep neural network, which combines efficient spatial and channel-based attention into a single Focus Gate module to encourage selective learning of polyp features. The Focus U-Net incorporates several further architectural modifications, including the addition of short-range skip connections and deep supervision. Furthermore, we introduce the Hybrid Focal loss, a new compound loss function based on the Focal loss and Focal Tversky loss, designed to handle class-imbalanced image segmentation. For our experiments, we selected five public datasets containing images of polyps obtained during optical colonoscopy: CVC-ClinicDB, Kvasir-SEG, CVC-ColonDB, ETIS-Larib PolypDB and EndoScene test set. We first perform a series of ablation studies and then evaluate the Focus U-Net on the CVC-ClinicDB and Kvasir-SEG datasets separately, and on a combined dataset of all five public datasets. To evaluate model performance, we use the Dice similarity coefficient (DSC) and Intersection over Union (IoU) metrics.ResultsOur model achieves state-of-the-art results for both CVC-ClinicDB and Kvasir-SEG, with a mean DSC of 0.941 and 0.910, respectively. When evaluated on a combination of five public polyp datasets, our model similarly achieves state-of-the-art results with a mean DSC of 0.878 and mean IoU of 0.809, a 14% and 15% improvement over the previous state-of-the-art results of 0.768 and 0.702, respectively.ConclusionsThis study shows the potential for deep learning to provide fast and accurate polyp segmentation results for use during colonoscopy. The Focus U-Net may be adapted for future use in newer non-invasive colorectal cancer screening and more broadly to other biomedical image segmentation tasks similarly involving class imbalance and requiring efficiency.

UACANet: Uncertainty Augmented Context Attention for Polyp Segmentation

UACENet: Uncertain Area Attention and Cross-Image Context Extraction Network for Polyp Segmentation.

DCANet: deep context attention network for automatic polyp segmentation

UM-Net: Rethinking ICGNet for polyp segmentation with uncertainty modeling

Adaptive Context Selection for Polyp Segmentation

ACU-TransNet: Attention and convolution-augmented UNet-transformer network for polyp segmentation

PDCA-Net: Parallel dual-channel attention network for polyp segmentation

Shallow Attention Network for Polyp Segmentation

An Edge-Enhanced Network for Polyp Segmentation

Three-stage polyp segmentation network based on reverse attention feature purification with Pyramid Vision Transformer

AFANet: Adaptive Feature Aggregation for Polyp Segmentation

Elongated Physiological Structure Segmentation via Spatial and Scale Uncertainty-aware Network

MAUNet: Polyp segmentation network based on multiscale feature fusion of attention U‐shaped network structure

DDANet: Dual Decoder Attention Network for Automatic Polyp Segmentation

Attention based multi-scale parallel network for polyp segmentation

Focus U-Net: A novel dual attention-gated CNN for polyp segmentation during colonoscopy

Efficient colorectal polyp segmentation using wavelet transformation and AdaptUNet: A hybrid U-Net

Polyp segmentation with interference filtering and dynamic uncertainty mining

M3ResU-Net: a Deep Residual Network for Multi-Center Colorectal Polyp Segmentation Based on Multi-Scale Learning and Attention Mechanism.

RA-DENet: Reverse Attention and Distractions Elimination Network for polyp segmentation

Uncertainty-aware Cascade Network for Ultrasound Image Segmentation with Ambiguous Boundary