High-quality color image restoration from a disturbed graded-index imaging system by deep neural networks

Xuanyu Hu,Zaipeng Duan,Yang Yang,Yehong Tan,Ruiqi Zhou,Jiong Xiao,Jinwei Zeng,Jian Wang
DOI: https://doi.org/10.1364/OE.485664
IF: 3.8
2023-01-01
Optics Express
Abstract:Imaging transmission plays an important role in endoscopic clinical diagnosis involved in modern medical treatment. However, image distortion due to various reasons has been a major obstacle to state-of-art endoscopic development. Here, as a preliminary study we demonstrate ultra-efficient recovery of exemplary 2D color images transmitted by a disturbed graded-index (GRIN) imaging system through the deep neural networks (DNNs). Indeed, the GRIN imaging system can preserve analog images through the GRIN waveguides with high quality, while the DNNs serve as an efficient tool for imaging distortion correction. Combining GRIN imaging systems and DNNs can greatly reduce the training process and achieve ideal imaging transmission. We consider imaging distortion under different realistic conditions and use both pix2pix and U-net type DNNs to restore the images, indicating the suitable network in each condition. This method can automatically cleanse the distorted images with superior robustness and accuracy, which can potentially be used in minimally invasive medical applications. & COPY; 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
What problem does this paper attempt to address?