Abstract:Endoscope size is a major design constraint that must be managed with the clinical demand for high-quality illumination and imaging. Existing commercial endoscopes most often use an arc lamp to produce bright, incoherent white light, requiring large-area fiber bundles to deliver sufficient illumination power to the sample. Moreover, the power instability of these light sources creates challenges for computer vision applications. We demonstrate an alternative illumination technique using red-green-blue laser light and a data-driven approach to combat the speckle noise that is a byproduct of coherent illumination. We frame the speckle artifact problem as an image-to-image translation task solved using conditional Generative Adversarial Networks (cGANs). To train the network, we acquire images illuminated with a coherent laser diode, with a laser diode source made partially- coherent using a laser speckle reducer, and with an incoherent LED light source as the target domain. We train networks using laser-illuminated endoscopic images of ex-vivo, porcine gastrointestinal tissues, augmented by images of laser-illuminated household and laboratory objects. The network is then benchmarked against state of-the-art optical and image processing speckle reduction methods, achieving an increased peak signal-to-noise ratio (PSNR) of 4.1 db, compared to 0.7 dB using optical speckle reduction, 0.6 dB using median filtering, and 0.5 dB using non-local means. This approach not only allows for endoscopes with smaller, more efficient light sources with extremely short triggering times, but it also enables imaging modalities that require both coherent and incoherent sources, such as combined widefield and speckle ow contrast imaging in a single image frame.

Influence of the spatial coherence of the illuminating laser on the imaging through scattering media via deep learning

Optimal Phase Mask Design for Coherent Modulation Imaging by Deep Learning

Ghost Imaging with N-order Speckle Light

Imaging and tracking through scattering medium with low bit depth speckle

Transfer Learning of Reconstructing Imaging From Speckles Generated by Different Spatial Coherence Light

Deep-learned speckle pattern and its application to ghost imaging

Imaging through a Scattering Medium under Different Intensities of Ambient Light Interference

Non-invasive Imaging Through Strongly Scattering Media Based on Speckle Pattern Estimation and Deconvolution

Speckle reduction in laser illuminated endoscopy using adversarial deep learning

Roles of scattered and ballistic photons in imaging through scattering media: a deep learning-based study

Imaging through scattering layers using a near-infrared low-spatial-coherence fiber random laser

Laser Speckle Denoising with Deep Convolutional Network

Hybrid-structure Network and Network Comparative Study for Deep-Learning-based Speckle-Modulating Optical Coherence Tomography

Sm-Net OCT: a Deep-Learning-based Speckle-Modulating Optical Coherence Tomography.

Imaging through opacity using a near-infrared low-spatial-coherence fiber light source.

Near-Infrared Speckle-Illumination Imaging Based on a Multidimensionally Disordered Fiber Laser

Photon-limited imaging through scattering medium based on deep learning

Nanolasers with Feedback as Low-Coherence Illumination Sources for Speckle-Free Imaging: A Numerical Analysis of the Superthermal Emission Regime

Research on improving imaging field of view of laser imaging through scattering media

Phase Imaging through Scattering Media Using Incoherent Light Source

Deep learning-based super-resolution in coherent imaging systems