Abstract:For optimum performance, deep learning methods, such as those applied for retinal and choroidal layer segmentation in optical coherence tomography (OCT) images, require sufficiently large and diverse labelled datasets for training. However, the acquisition and labelling of such data can be difficult or infeasible due to privacy reasons (particularly in the medical domain), accessing patient images such as those with specific pathologies, and the cost and time investment to annotate large volumes of data by clinical experts. Data augmentation is one solution to address this issue, either using simple variations and transformations of the images (e.g. flips, brightness) or using synthetic data from sophisticated generative methods such as generative adversarial networks (GANs). Semi-supervised learning (SSL) is another technique which aims to utilise unlabelled data to enhance the performance of deep learning methods and is beneficial where significant amounts of data may be available but are not labelled. In this study, we aim to enhance patch-based OCT retinal and choroidal layer segmentation with both GAN-based data augmentation and SSL. In particular, we employ a conditional StyleGAN2 to generate synthetic patches for data augmentation and a similar unconditional GAN for pre-training the patch classifier to perform SSL. In doing so, we propose a new patch classifier architecture based on the discriminator architecture to improve performance, in addition to the SSL benefit. Compared to previous methods, the proposed data augmentation approach provides an improved data augmentation performance for patch classification with its effectiveness widespread, particularly in the case of low data, across three different OCT datasets encompassing a range of scanning parameters, noise levels, pathology and participant variability. The method provides some subsequent improvements in boundary delineation which is of high importance from a clinical perspective. Additionally, the proposed SSL approach boosts classification performance and boundary delineation performance in some cases which provides further usefulness in the case of low data. The proposed methods can be utilised to enhance OCT segmentation methods, which may be of considerable benefit for both clinicians and researchers.

Data augmentation for patch-based OCT chorio-retinal segmentation using generative adversarial networks

Enhancing OCT patch-based segmentation with improved GAN data augmentation and semi-supervised learning

Comparative Analysis of Data Augmentation for Retinal OCT Biomarker Segmentation

GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks

A generative adversarial network with multi-scale convolution and dilated convolution res-network for OCT retinal image despeckling

Generative Adversarial Networks Synthesize Realistic OCT Images of the Retina

Automatic choroidal segmentation in OCT images using supervised deep learning methods

Creating Realistic Anterior Segment Optical Coherence Tomography Images using Generative Adversarial Networks

DR-GAN: Conditional Generative Adversarial Network for Fine-Grained Lesion Synthesis on Diabetic Retinopathy Images

GAN-based Super-Resolution and Segmentation of Retinal Layers in Optical coherence tomography Scans

Augmenting data with GANs to segment melanoma skin lesions

Pixel Level Data Augmentation for Semantic Image Segmentation Using Generative Adversarial Networks.

VSG-GAN: A high-fidelity image synthesis method with semantic manipulation in retinal fundus image

Generative Adversarial Networks for Data Augmentation

Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective

Conditional Generative Adversarial Networks for Data Augmentation and Adaptation in Remotely Sensed Imagery

AADG: Automatic Augmentation for Domain Generalization on Retinal Image Segmentation.

Data augmentation using generative adversarial networks (CycleGAN) to improve generalizability in CT segmentation tasks

Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography

DACov: A Deeper Analysis of Data Augmentation on the Computed Tomography Segmentation Problem

Enhancing MR image segmentation with realistic adversarial data augmentation