Abstract:A resolution enhancement technique for optical coherence tomography (OCT), based on Generative Adversarial Networks (GANs), was developed and investigated. GANs have been previously used for resolution enhancement of photography and optical microscopy images. We have adapted and improved this technique for OCT image generation. Conditional GANs (cGANs) were trained on a novel set of ultrahigh resolution spectral domain OCT volumes, termed micro-OCT, as the high-resolution ground truth (∼1 <i>μ</i>m isotropic resolution). The ground truth was paired with a low-resolution image obtained by synthetically degrading resolution 4x in one of (1-D) or both axial and lateral axes (2-D). Cross-sectional image (B-scan) volumes obtained from <i>in vivo</i> imaging of human labial (lip) tissue and mouse skin were used in separate feasibility experiments. Accuracy of resolution enhancement compared to ground truth was quantified with human perceptual accuracy tests performed by an OCT expert. The GAN loss in the optimization objective, noise injection in both the generator and discriminator models, and multi-scale discrimination were found to be important for achieving realistic speckle appearance in the generated OCT images. The utility of high-resolution speckle recovery was illustrated by an example of micro-OCT imaging of blood vessels in lip tissue. Qualitative examples applying the models to image data from outside of the training data distribution, namely human retina and mouse bladder, were also demonstrated, suggesting potential for cross-domain transferability. This preliminary study suggests that deep learning generative models trained on OCT images from high-performance prototype systems may have potential in enhancing lower resolution data from mainstream/commercial systems, thereby bringing cutting-edge technology to the masses at low cost.

More Realistic Low-Resolution OCT Image Generation Approach for Training Deep Neural Networks

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Axial Super-Resolution Study for Optical Coherence Tomography Images Via Deep Learning

Infrared Image Super Resolution Using Gan With Infrared Image Prior

N2NSR-OCT: Simultaneous Denoising and Super-Resolution in Optical Coherence Tomography Images Using Semisupervised Deep Learning

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Sparse-Based Domain Adaptation Network for OCTA Image Super-Resolution Reconstruction

Imaging depth adaptive resolution enhancement for optical coherence tomography via deep neural network with external attention

Retinal fundus image superresolution generated by optical coherence tomography based on a realistic mixed attention GAN

Iterative-in-Iterative Super-Resolution Biomedical Imaging Using One Real Image

Axial super-resolution optical coherence tomography via complex-valued network

Frequency-aware optical coherence tomography image super-resolution via conditional generative adversarial neural network

RIRGAN: an End-to-end Lightweight Multi-Task Learning Method for Brain MRI Super-Resolution and Denoising

Research on Image Super-Resolution Reconstruction Mechanism based on Convolutional Neural Network

Image enhancement of wide-field retinal optical coherence tomography angiography by super-resolution angiogram reconstruction generative adversarial network

O-PRESS: Boosting OCT axial resolution with Prior guidance, Recurrence, and Equivariant Self-Supervision

Memory-efficient High-resolution OCT Volume Synthesis with Cascaded Amortized Latent Diffusion Models