Abstract:Objective. Endoscopic imaging is a visualization method widely used in minimally invasive surgery. However, owing to the strong reflection of the mucus layer on the organs, specular highlights often appear to degrade the imaging performance. Thus, it is necessary to develop an effective highlight removal method for endoscopic imaging. Approach. A specular highlight removal method using a partial attention network (PatNet) for endoscopic imaging is proposed to reduce the interference of bright light in endoscopic surgery. The method is designed as two procedures: highlight segmentation and endoscopic image inpainting. Image segmentation uses brightness threshold based on illumination compensation to divide the endoscopic image into the highlighted mask and the non-highlighted area. The image inpainting algorithm uses a partial convolution network that integrates an attention mechanism. A mask dataset with random hopping points is designed to simulate specular highlight in endoscopic imaging for network training. Through the filtering of masks, the method can focus on recovering defective pixels and preserving valid pixels as much as possible. Main results. The PatNet is compared with 3 highlight segmentation methods, 3 imaging inpainting methods and 5 highlight removal methods for effective analysis. Experimental results show that the proposed method provides better performance in terms of both perception and quantification. In addition, surgeons are invited to score the processing results for different highlight removal methods under realistic reflection conditions. The PatNet received the highest score of 4.18. Correspondingly, the kendall's W is 0.757 and the asymptotic significance p=0.000<0.01, revealing that the subjective scores have good consistency and confidence. Significance. Generally, the method can realize irregular shape highlight reflection removal and image restoration close to the ground truth of endoscopic images. This method can improve the quality of endoscopic imaging for accurate image analysis.

Specular Reflections Removal for Endoscopic Images Based on Improved Criminisi Algorithm

Specular Reflections Detection and Removal for Endoscopic Images Based on Brightness Classification

EndoSRR: a comprehensive multi-stage approach for endoscopic specular reflection removal

5-1-2005 Bias Affiliated With Two Variants Of Cohen ’ s d When Determining U 1 As A Measure Of The Percent Of Non-Overlap

Simple and Efficient Method for Specularity Removal in an Image

Specular Highlight Detection Based on Color Distribution for Endoscopic Images

Single Image Reflection Removal with Absorption Effect

Parameter-Free Matrix Decomposition for Specular Reflections Removal in Endoscopic Images

Specular highlight removal for endoscopic images using partial attention network

A Hessian-Based Technique for Specular Reflection Detection and Inpainting in Colonoscopy Images

EasySpec: Automatic Specular Reflection Detection and Suppression From Endoscopic Images

Chromaticity-based separation of reflection components in a single image

PAR<SUP>2</SUP>Net: End-to-End Panoramic Image Reflection Removal

[Characterization of the fibroblastic system. V. In vitro culture of the cardiac valves].

Adaptive specular reflection detection and inpainting in colonoscopy video frames

Panoramic Image Reflection Removal

Specular highlight removal of light field based on dichromatic reflection and total variation optimizations

Highlight Removal for Endoscopic Images based on Accelerated Adaptive Non-Convex RPCA Decomposition

Specular highlight removal of light field image combining dichromatic reflection with exemplar patch filling

A Highlight Removal Method for Capsule Endoscopy Images