Abstract:Background: Endoscopy image enhancement technology provides doctors with clearer and more detailed images for observation and diagnosis, allowing doctors to assess lesions more accurately. Unlike most other endoscopy images, cystoscopy images face more complex and diverse image degradation because of their underwater imaging characteristics. Among the various causes of image degradation, the blood haze resulting from bladder mucosal bleeding make the background blurry and unclear, severely affecting diagnostic efficiency, even leading to misjudgment. Materials and Methods: We propose a deep learning-based approach to mitigate the impact of blood haze on cystoscopy images. The approach consists of two parts as follows: a blood haze removal network and a contrast enhancement algorithm. First, we adopt Feature Fusion Attention Network (FFA-Net) and transfer learning in the field of deep learning to remove blood haze from cystoscopy images and introduce perceptual loss to constrain the network for better visual results. Second, we enhance the image contrast by remapping the gray scale of the blood haze-free image and performing weighted fusion of the processed image and the original image. Results: In the blood haze removal stage, the algorithm proposed in this article achieves an average peak signal-to-noise ratio of 29.44 decibels, which is 15% higher than state-of-the-art traditional methods. The average structural similarity and perceptual image patch similarity reach 0.9269 and 0.1146, respectively, both superior to state-of-the-art traditional methods. Besides, our method is the best in keeping color balance after removing the blood haze. In the image enhancement stage, our algorithm enhances the contrast of vessels and tissues while preserving the original colors, expanding the dynamic range of the image. Conclusion: The deep learning-based cystoscopy image enhancement method is significantly better than other traditional methods in both qualitative and quantitative evaluation. The application of artificial intelligence will provide clearer, higher contrast cystoscopy images for medical diagnosis.

Deblurring and Restoration of Gastroscopy Image Based on Gradient-guidance Generative Adversarial Networks

MND-GAN: A Research on Image Deblurring Algorithm Based on Generative Adversarial Network

Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection

Endoscopic Image Deblurring and Super-Resolution Reconstruction Based on Deep Learning

Deep Learning Based Cystoscopy Image Enhancement

A generative adversarial network with multi-scale convolution and dilated convolution res-network for OCT retinal image despeckling

ADGAN: an Asymmetric Despeckling Generative Adversarial Network for Unpaired OCT Image Speckle Noise Reduction

Fundus Image Enhancement Via Semi-Supervised GAN and Anatomical Structure Preservation

Image Deblurring Method Based on Simplified Gated Activation Network

Image Motion Deblurring Based on Deep Residual Shrinkage and Generative Adversarial Networks

Enhanced Pathology Image Quality with Restore–Generative Adversarial Network

Endoscopic Video Deblurring Via Synthesis

Image Text Deblurring Method Based on Generative Adversarial Network

Image Motion Blur Removal Algorithm Based on Generative Adversarial Network

A General Endoscopic Image Enhancement Method Based on Pre-trained Generative Adversarial Networks

A Multi-scale Generalized Shrinkage Threshold Network for Image Blind Deblurring in Remote Sensing

Image motion deblurring via attention generative adversarial network

A Multiscale Generalized Shrinkage Threshold Network for Image Blind Deblurring in Remote Sensing

Image Deblurring using GAN

Dehaze of Cataractous Retinal Images Using an Unpaired Generative Adversarial Network

Dual-Branch Discrimination Network Using Multiple Sparse Priors for Image Deblurring