Abstract:Background Colorectal cancer is one of the commonest malignancies which threaten the health of human. Most of the colorectal cancers arise from adenomatous polyps, screening for this cancer is effective not only for early detection but also for prevention. Endoscopic examination is an important way to reveal polyps. At present, the main limitation of colonoscopy is the high polyp miss rate. This study aims to improve the accuracy of detection and save doctors’ time with deep learning techniques. Methods The data we used is a combination of CVC-ColonDB and CVC-ClinicDB which contains 912 images with associated polyps. We treat the rest part of a colonoscopy image except polys as background. Convolutional networks are applied to polyp localization and segmentation. There are three different architectures which include FCN, SegNet and modified ResNet. We trained convolutional networks with these architectures respectively and evaluated these models based on Intersection over Union (IoU) and accuracy. Results The segmentation results on the test set are reported in table 1 and the accuracy of three architectures is greater than 90%. Results achieved in SegNet and modified ResNet are very encouraging, with a IoU higher than 50% for polyps. IDDF2018-ABS-0260 Figure 1 shows qualitative results of three architectures. It can be seen that all of them recognise the location of polyp successfully and rows 2 and 3 show finer boundaries. The results are reported on test setAbstract IDDF2018-ABS-0260 Table 1 Endoluminal scene semantic segmentation results for different architectures Architecture IoU background IoU polyp IoU mean Acc mean FCN8 94.024 46.99 70.51 94.32 SegNet 94.897 53.795 74.346 95.183 ResNet with changes 96.029 64.0307 80.0299 96.291 Abstract IDDF2018-ABS-0260 Figure 1 Examples of predictions: (a) FCN8 model; (b) SegNet model; (c) modified ResNet model. From left to right, each column represents ground truth, prediction and a translucent prediction image Conclusions Compare to traditional time-consuming hand-crafted segmentation methods, when considering polyp segmentation, approaches based on deep learning are time-saving and effective, showing good results in colonoscopy images. Given that three architectures we mentioned above not only performs well but also allows for nearly real-time processing, it has a great potential in polyp localization and segmentation.

CRPU-NET: a deep learning model based semantic segmentation for the detection of colorectal polyp in lower gastrointestinal tract

An approach of polyp segmentation from colonoscopy images using Dilated-U-Net-Seg – A deep learning network

IDDF2018-ABS-0260 Deep Learning for Polyp Segmentation

PRCNet: A parallel reverse convolutional attention network for colorectal polyp segmentation

Colorectal Polyp Segmentation by U-Net with Dilation Convolution

TransResU-Net: Transformer based ResU-Net for Real-Time Colonoscopy Polyp Segmentation

IDDF2018-ABS-0261 Polyp Detection Using an Unet Based Model

TransResU-Net: A Transformer based ResU-Net for Real-Time Colon Polyp Segmentation

IRv2-Net: A Deep Learning Framework for Enhanced Polyp Segmentation Performance Integrating InceptionResNetV2 and UNet Architecture with Test Time Augmentation Techniques

Dual encoder–decoder-based deep polyp segmentation network for colonoscopy images

Efficient colorectal polyp segmentation using wavelet transformation and AdaptUNet: A hybrid U-Net

Automatic Polyp Segmentation in Colonoscopy Images Using a Modified Deep Convolutional Encoder-Decoder Architecture

PRAPNet: A Parallel Residual Atrous Pyramid Network for Polyp Segmentation

An Interpretable Deep Neural Network for Colorectal Polyp Diagnosis under Colonoscopy

Automatic Polyp Segmentation Using Convolutional Neural Networks

IDDF2018-ABS-0257 Detecting and Segmenting Polyps Using a Deep Learning-Based Model

CRIS: Collaborative Refinement Integrated with Segmentation for Polyp Segmentation

A Comprehensive Study on Colorectal Polyp Segmentation with ResUNet++, Conditional Random Field and Test-Time Augmentation

AGCNet: A Precise Adaptive Global Context Network for Real-Time Colonoscopy

APRNet: Alternative Prediction Refinement Network for Polyp Segmentation.

IDDF2018-ABS-0259 Segmentation of Intestinal Polyps Via a Deep Learning Algorithm