Abstract:Image desmoking is a significant aspect of endoscopic image processing, effectively mitigating visual field obstructions without the need for additional surgical interventions. However, current smoke removal techniques tend to apply comprehensive video enhancement to all frames, encompassing both smoke-free and smoke-affected images, which not only escalates computational costs but also introduces potential noise during the enhancement of smoke-free images. In response to this challenge, this paper introduces an approach for classifying images that contain surgical smoke within endoscopic scenes. This classification method provides crucial target frame information for enhancing surgical smoke removal, improving the scientific robustness, and enhancing the real-time processing capabilities of image-based smoke removal method. The proposed endoscopic smoke image classification algorithm based on the improved Poolformer model, augments the model's capacity for endoscopic image feature extraction. This enhancement is achieved by transforming the Token Mixer within the encoder into a multi-branch structure akin to ConvNeXt, a pure convolutional neural network. Moreover, the conversion to a single-path topology during the prediction phase elevates processing speed. Experiments use the endoscopic dataset sourced from the Hamlyn Centre Laparoscopic/Endoscopic Video Dataset, augmented by Blender software rendering. The dataset comprises 3,800 training images and 1,200 test images, distributed in a 4:1 ratio of smoke-free to smoke-containing images. The outcomes affirm the superior performance of this paper's approach across multiple parameters. Comparative assessments against existing models, such as mobilenet_v3, efficientnet_b7, and ViT-B/16, substantiate that the proposed method excels in accuracy, sensitivity, and inference speed. Notably, when contrasted with the Poolformer_s12 network, the proposed method achieves a 2.3% enhancement in accuracy, an 8.2% boost in sensitivity, while incurring a mere 6.4 frames per second reduction in processing speed, maintaining 87 frames per second. The results authenticate the improved performance of the refined Poolformer model in endoscopic smoke image classification tasks. This advancement presents a lightweight yet effective solution for the automatic detection of smoke-containing images in endoscopy. This approach strikes a balance between the accuracy and real-time processing requirements of endoscopic image analysis, offering valuable insights for targeted desmoking process.

A Smoke Removal Method Based on Combined Data and Modified U-Net for Endoscopic Images

A Self-Supervised Network-Based Smoke Removal and Depth Estimation for Monocular Endoscopic Videos

A Slight Smoke Perceptual Network.

Attention-Aware Laparoscopic Image Desmoking Network with Lightness Embedding and Hybrid Guided Embedding

A Smoke Removal Method for Laparoscopic Images

Generative Smoke Removal

Can Image Enhancement be Beneficial to Find Smoke Images in Laparoscopic Surgery?

Endoscopic image classification algorithm based on Poolformer

Automatic Smoke Analysis in Minimally Invasive Surgery by Image-based Machine Learning

Self-Supervised Video Desmoking for Laparoscopic Surgery

MARS-GAN: Multilevel-Feature-Learning Attention-Aware Based Generative Adversarial Network for Removing Surgical Smoke

LSD3K: A Benchmark for Smoke Removal from Laparoscopic Surgery Images

Single Image Desmoking via Attentive Generative Adversarial Network for Smoke Detection Process

Deep Smoke Segmentation

Desmoking laparoscopy surgery images using an image-to-image translation guided by an embedded dark channel

Surgical smoke removal via residual Swin transformer network

Progressive Frequency-Aware Network for Laparoscopic Image Desmoking

An Integrated Smoke Detection Method Based on Convolutional Neural Network and Image Processing

Smoke Detection Algorithm Based on Negative Sample Mining

Visual Smoke Detection Based on Ensemble Deep CNNs.

A lightweight network for real-time smoke semantic segmentation based on dual paths