Abstract:Image desmoking is a significant aspect of endoscopic image processing, effectively mitigating visual field obstructions without the need for additional surgical interventions. However, current smoke removal techniques tend to apply comprehensive video enhancement to all frames, encompassing both smoke-free and smoke-affected images, which not only escalates computational costs but also introduces potential noise during the enhancement of smoke-free images. In response to this challenge, this paper introduces an approach for classifying images that contain surgical smoke within endoscopic scenes. This classification method provides crucial target frame information for enhancing surgical smoke removal, improving the scientific robustness, and enhancing the real-time processing capabilities of image-based smoke removal method. The proposed endoscopic smoke image classification algorithm based on the improved Poolformer model, augments the model's capacity for endoscopic image feature extraction. This enhancement is achieved by transforming the Token Mixer within the encoder into a multi-branch structure akin to ConvNeXt, a pure convolutional neural network. Moreover, the conversion to a single-path topology during the prediction phase elevates processing speed. Experiments use the endoscopic dataset sourced from the Hamlyn Centre Laparoscopic/Endoscopic Video Dataset, augmented by Blender software rendering. The dataset comprises 3,800 training images and 1,200 test images, distributed in a 4:1 ratio of smoke-free to smoke-containing images. The outcomes affirm the superior performance of this paper's approach across multiple parameters. Comparative assessments against existing models, such as mobilenet_v3, efficientnet_b7, and ViT-B/16, substantiate that the proposed method excels in accuracy, sensitivity, and inference speed. Notably, when contrasted with the Poolformer_s12 network, the proposed method achieves a 2.3% enhancement in accuracy, an 8.2% boost in sensitivity, while incurring a mere 6.4 frames per second reduction in processing speed, maintaining 87 frames per second. The results authenticate the improved performance of the refined Poolformer model in endoscopic smoke image classification tasks. This advancement presents a lightweight yet effective solution for the automatic detection of smoke-containing images in endoscopy. This approach strikes a balance between the accuracy and real-time processing requirements of endoscopic image analysis, offering valuable insights for targeted desmoking process.

LSD3K: A Benchmark for Smoke Removal from Laparoscopic Surgery Images

Self-Supervised Video Desmoking for Laparoscopic Surgery

A Smoke Removal Method for Laparoscopic Images

Attention-Aware Laparoscopic Image Desmoking Network with Lightness Embedding and Hybrid Guided Embedding

Can Image Enhancement be Beneficial to Find Smoke Images in Laparoscopic Surgery?

Desmoking laparoscopy surgery images using an image-to-image translation guided by an embedded dark channel

A Smoke Removal Method Based on Combined Data and Modified U-Net for Endoscopic Images

Progressive Frequency-Aware Network for Laparoscopic Image Desmoking

A Self-Supervised Network-Based Smoke Removal and Depth Estimation for Monocular Endoscopic Videos

Automatic Smoke Analysis in Minimally Invasive Surgery by Image-based Machine Learning

Generative Smoke Removal

MARS-GAN: Multilevel-Feature-Learning Attention-Aware Based Generative Adversarial Network for Removing Surgical Smoke

Single Image Desmoking via Attentive Generative Adversarial Network for Smoke Detection Process

Realistic Surgical Image Dataset Generation Based On 3D Gaussian Splatting

Endoscopic image classification algorithm based on Poolformer

Surgical smoke removal via residual Swin transformer network

Laparoscopy Surgery CO2 Removal via Generative Adversary Network and Dark Channel Prior

Toward Zero-Shot Learning for Visual Dehazing of Urological Surgical Robots

Irrigation eliminates smoke formation in laser laparoscopic surgery: ex vivo results.

A Novel Hybrid Endoscopic Dataset for Evaluating Machine Learning-based Photometric Image Enhancement Models

CholecInstanceSeg: A Tool Instance Segmentation Dataset for Laparoscopic Surgery