Abstract:Colonoscopy is a reliable diagnostic method to detect colorectal polyps early on and prevent colorectal cancer. The current examination techniques face a significant challenge of high missed rates, resulting in numerous undetected polyps and irregularities. Automated and real-time segmentation methods can help endoscopists to segment the shape and location of polyps from colonoscopy images in order to facilitate clinician's timely diagnosis and interventions. Different parameters like shapes, small sizes of polyps, and their close resemblance to surrounding tissues make this task challenging. Furthermore, high-definition image quality and reliance on the operator make real-time and accurate endoscopic image segmentation more challenging. Deep learning models utilized for segmenting polyps, designed to capture diverse patterns, are becoming progressively complex. This complexity poses challenges for real-time medical operations. In clinical settings, utilizing automated methods requires the development of accurate, lightweight models with minimal latency, ensuring seamless integration with endoscopic hardware devices. To address these challenges, in this study a novel lightweight and more generalized Enhanced Nanonet model, an improved version of Nanonet using NanonetB for real-time and precise colonoscopy image segmentation, is proposed. The proposed model enhances the performance of Nanonet using Nanonet B on the overall prediction scheme by applying data augmentation, Conditional Random Field (CRF), and Test-Time Augmentation (TTA). Six publicly available datasets are utilized to perform thorough evaluations, assess generalizability, and validate the improvements: Kvasir-SEG, Endotect Challenge 2020, Kvasir-instrument, CVC-ClinicDB, CVC-ColonDB, and CVC-300. Through extensive experimentation, using the Kvasir-SEG dataset, our model achieves a mIoU score of 0.8188 and a Dice coefficient of 0.8060 with only 132,049 parameters and employing minimal computational resources. A thorough cross-dataset evaluation was performed to assess the generalization capability of the proposed Enhanced Nanonet model across various publicly available polyp datasets for potential real-world applications. The result of this study shows that using CRF (Conditional Random Fields) and TTA (Test-Time Augmentation) enhances performance within the same dataset and also across diverse datasets with a model size of just 132,049 parameters. Also, the proposed method indicates improved results in detecting smaller and sessile polyps (flats) that are significant contributors to the high miss rates.

IPNet: An Interpretable Network with Progressive Loss for Whole-stage Colorectal Disease Diagnosis

An Interpretable Deep Neural Network for Colorectal Polyp Diagnosis under Colonoscopy

DLGNet: A dual-branch lesion-aware network with the supervised Gaussian Mixture model for colon lesions classification in colonoscopy images

D 2 polyp-Net: A cross-modal space-guided network for real-time colorectal polyp detection and diagnosis

D2polyp-Net: A Cross-Modal Space-Guided Network for Real-Time Colorectal Polyp Detection and Diagnosis

ColonNet: A novel polyp segmentation framework based on LK-RFB and GPPD

Deep learning model with pathological knowledge for detection of colorectal neuroendocrine tumor

Medical Image Classification Based on Information Interaction Perception Mechanism

Diagnostic evaluation of a deep learning model for optical diagnosis of colorectal cancer

Double Attention for Pathology Image Diagnosis Network with Visual Interpretability.

ECTransNet: An Automatic Polyp Segmentation Network Based on Multi-scale Edge Complementary

A Pathology Image Diagnosis Network With Visual Interpretability And Structured Diagnostic Report

PRCNet: A parallel reverse convolutional attention network for colorectal polyp segmentation

SSN: A Stair-Shape Network for Real-Time Polyp Segmentation in Colonoscopy Images.

Information bottleneck-based interpretable multitask network for breast cancer classification and segmentation

DFE-IANet: A Method for Polyp Image Classification Based on Dual-domain Feature Extraction and Interaction Attention

Real-time colorectal cancer diagnosis using PR-OCT with deep learning

ABC-Net: Area-Boundary Constraint Network With Dynamical Feature Selection for Colorectal Polyp Segmentation

Enhanced accuracy with Segmentation of Colorectal Polyp using NanoNetB, and Conditional Random Field Test-Time Augmentation

MSNet: a novel network with comprehensive multi-scale feature integration for gastric cancer and colon polyp segmentation

IMAL‐Net: Interpretable multi‐task attention learning network for invasive lung adenocarcinoma screening in CT images