Abstract:Layer segmentation is important to quantitative analysis of retinal optical coherence tomography (OCT). Recently, deep learning based methods have been developed to automate this task and yield remarkable performance. However, due to the large spatial gap and potential mismatch between the B-scans of an OCT volume, all of them were based on 2D segmentation of individual B-scans, which may lose the continuity and diagnostic information of the retinal layers in 3D space. Besides, most of these methods required dense annotation of the OCT volumes, which is labor-intensive and expertise-demanding. This work presents a novel framework based on hybrid 2D-3D convolutional neural networks (CNNs) to obtain continuous 3D retinal layer surfaces from OCT volumes, which works well with both full and sparse annotations. The 2D features of individual B-scans are extracted by an encoder consisting of 2D convolutions. These 2D features are then used to produce the alignment displacement vectors and layer segmentation by two 3D decoders coupled via a spatial transformer module. Two losses are proposed to utilize the retinal layers' natural property of being smooth for B-scan alignment and layer segmentation, respectively, and are the key to the semi-supervised learning with sparse annotation. The entire framework is trained end-to-end. To the best of our knowledge, this is the first work that attempts 3D retinal layer segmentation in volumetric OCT images based on CNNs. Experiments on a synthetic dataset and three public clinical datasets show that our framework can effectively align the B-scans for potential motion correction, and achieves superior performance to state-of-the-art 2D deep learning methods in terms of both layer segmentation accuracy and cross-B-scan 3D continuity in both fully and semi-supervised settings, thus offering more clinical values than previous works.

FRCNN: A Combination of Fuzzy-rough-set-based Feature Discretization and Convolutional Neural Network for Segmenting Subretinal Fluid Lesions

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

Retinal Vessel Segmentation Via Cross-attention Feature Fusion

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Multi-scale pathological fluid segmentation in OCT with a novel curvature loss in convolutional neural network

FNeXter: A Multi-Scale Feature Fusion Network Based on ConvNeXt and Transformer for Retinal OCT Fluid Segmentation

Fluid Region Segmentation in OCT Images Based on Convolution Neural Network

Automated segmentation of retinal fluid volumes from structural and angiographic optical coherence tomography using deep learning

Automatic Segmentation of Hyperreflective Foci in OCT Images Based on Lightweight DBR Network.

Cystoid macular edema segmentation of Optical Coherence Tomography images using fully convolutional neural networks and fully connected CRFs

Segmentation of retinal fluid based on deep learning: application of three-dimensional fully convolutional neural networks in optical coherence tomography images.

Retinal Fluid Segmentation and Detection in Optical Coherence Tomography Images using Fully Convolutional Neural Network

Diabetic Retinopathy Lesion Segmentation Using Deep Multi-Scale Framework

Automated Retinal Layer Segmentation in Optical Coherence Tomography Images with Intraretinal Fluid

Segmentation of retinal detachment and retinoschisis in OCT images based on complementary multi-class segmentation networks.

Remote sensing image segmentation based on the fuzzy deep convolutional neural network

Joint disc and cup segmentation based on recurrent fully convolutional network

Simple Code Implementation for Deep Learning–Based Segmentation to Evaluate Central Serous Chorioretinopathy in Fundus Photography

Automated Segmentation of Choroidal Neovascularization on Optical Coherence Tomography Angiography Images of Neovascular Age-Related Macular Degeneration Patients Based on Deep Learning

Automatic fluid segmentation in retinal optical coherence tomography images using attention based deep learning

DRFNet: a deep radiomic fusion network for nAMD/PCV differentiation in OCT images