Abstract:A resolution enhancement technique for optical coherence tomography (OCT), based on Generative Adversarial Networks (GANs), was developed and investigated. GANs have been previously used for resolution enhancement of photography and optical microscopy images. We have adapted and improved this technique for OCT image generation. Conditional GANs (cGANs) were trained on a novel set of ultrahigh resolution spectral domain OCT volumes, termed micro-OCT, as the high-resolution ground truth (∼1 <i>μ</i>m isotropic resolution). The ground truth was paired with a low-resolution image obtained by synthetically degrading resolution 4x in one of (1-D) or both axial and lateral axes (2-D). Cross-sectional image (B-scan) volumes obtained from <i>in vivo</i> imaging of human labial (lip) tissue and mouse skin were used in separate feasibility experiments. Accuracy of resolution enhancement compared to ground truth was quantified with human perceptual accuracy tests performed by an OCT expert. The GAN loss in the optimization objective, noise injection in both the generator and discriminator models, and multi-scale discrimination were found to be important for achieving realistic speckle appearance in the generated OCT images. The utility of high-resolution speckle recovery was illustrated by an example of micro-OCT imaging of blood vessels in lip tissue. Qualitative examples applying the models to image data from outside of the training data distribution, namely human retina and mouse bladder, were also demonstrated, suggesting potential for cross-domain transferability. This preliminary study suggests that deep learning generative models trained on OCT images from high-performance prototype systems may have potential in enhancing lower resolution data from mainstream/commercial systems, thereby bringing cutting-edge technology to the masses at low cost.

Esophageal optical coherence tomography image synthesis using an adversarially learned variational autoencoder

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Synthesizing Contrast-enhanced Computed Tomography Images with an Improved Conditional Generative Adversarial Network

This Intestine Does Not Exist: Multiscale Residual Variational Autoencoder for Realistic Wireless Capsule Endoscopy Image Generation

Deep‐learning visualization enhancement method for optical coherence tomography angiography in dermatology

Augmentation of Virtual Endoscopic Images with Intra-operative Data using Content-Nets

VSG-GAN: A high-fidelity image synthesis method with semantic manipulation in retinal fundus image

A deep-learning-based unsupervised model on esophageal manometry using variational autoencoder

End-to-end autoencoding architecture for the simultaneous generation of medical images and corresponding segmentation masks

Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography

Creating Realistic Anterior Segment Optical Coherence Tomography Images using Generative Adversarial Networks

Medical variational autoencoder and generative adversarial network for medical imaging

CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training

Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders

Image enhancement of wide-field retinal optical coherence tomography angiography by super-resolution angiogram reconstruction generative adversarial network

Unpaired Optical Coherence Tomography Angiography Image Super-Resolution via Frequency-Aware Inverse-Consistency GAN

Brain Lesion Synthesis via Progressive Adversarial Variational Auto-Encoder

Transfer Learning and Interpretable Analysis-Based Quality Assessment of Synthetic Optical Coherence Tomography Images by CGAN Model for Retinal Diseases

Frequency-aware optical coherence tomography image super-resolution via conditional generative adversarial neural network

Generating OCT B-Scan DME images using optimized Generative Adversarial Networks (GANs)

VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers