Abstract:A resolution enhancement technique for optical coherence tomography (OCT), based on Generative Adversarial Networks (GANs), was developed and investigated. GANs have been previously used for resolution enhancement of photography and optical microscopy images. We have adapted and improved this technique for OCT image generation. Conditional GANs (cGANs) were trained on a novel set of ultrahigh resolution spectral domain OCT volumes, termed micro-OCT, as the high-resolution ground truth (∼1 <i>μ</i>m isotropic resolution). The ground truth was paired with a low-resolution image obtained by synthetically degrading resolution 4x in one of (1-D) or both axial and lateral axes (2-D). Cross-sectional image (B-scan) volumes obtained from <i>in vivo</i> imaging of human labial (lip) tissue and mouse skin were used in separate feasibility experiments. Accuracy of resolution enhancement compared to ground truth was quantified with human perceptual accuracy tests performed by an OCT expert. The GAN loss in the optimization objective, noise injection in both the generator and discriminator models, and multi-scale discrimination were found to be important for achieving realistic speckle appearance in the generated OCT images. The utility of high-resolution speckle recovery was illustrated by an example of micro-OCT imaging of blood vessels in lip tissue. Qualitative examples applying the models to image data from outside of the training data distribution, namely human retina and mouse bladder, were also demonstrated, suggesting potential for cross-domain transferability. This preliminary study suggests that deep learning generative models trained on OCT images from high-performance prototype systems may have potential in enhancing lower resolution data from mainstream/commercial systems, thereby bringing cutting-edge technology to the masses at low cost.

Restoration of X-ray phase-contrast imaging based on generative adversarial networks

Single-shot Grating-Based X-ray Phase Contrast Imaging Via Generative Adversarial Network

Principles of Different X-ray Phase-Contrast Imaging: A Review

Grating-Based X-Ray Phase Contrast Imaging With a Polycapillary Semilens

Synthesizing Contrast-enhanced Computed Tomography Images with an Improved Conditional Generative Adversarial Network

Phase Retrieval for X-ray Differential Phase Contrast Radiography with Knowledge Transfer Learning from Virtual Differential Absorption Model.

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Virtual Differential Phase‐contrast and Dark‐field Imaging of X‐ray Absorption Images Via Deep Learning

Enhancing the X-Ray Differential Phase Contrast Image Quality With Deep Learning Technique

Contrast Phase Classification with a Generative Adversarial Network

Phase Contrast Image Restoration by Formulating Its Imaging Principle and Reversing the Formulation with Deep Neural Networks

X-Ray Phase-Contrast Image Reconstruction Based on the Chambolle-Pock Algorithm

Enhanced Pathology Image Quality with Restore–Generative Adversarial Network

Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography

X-ray Phase Contrast Computed Tomographic Elementary Experiments under Incoherent Conditions

Multi-phase synthetic contrast enhancement in interventional computed tomography for guiding renal cryotherapy

Fast X-Ray Phase-Contrast Imaging Using High Resolution Detector

In-Line Phase Contrast Imaging Using A Micro-Focus X-Ray Source

Model-driven CT reconstruction algorithm for nano-resolution X-ray phase contrast imaging

Single-shot grating-based x-ray differential phase contrast imaging with a modified analyzer grating

Subnanoradian X-ray phase-contrast imaging using a far-field interferometer of nanometric phase gratings