Abstract:Layer segmentation is important to quantitative analysis of retinal optical coherence tomography (OCT). Recently, deep learning based methods have been developed to automate this task and yield remarkable performance. However, due to the large spatial gap and potential mismatch between the B-scans of an OCT volume, all of them were based on 2D segmentation of individual B-scans, which may lose the continuity and diagnostic information of the retinal layers in 3D space. Besides, most of these methods required dense annotation of the OCT volumes, which is labor-intensive and expertise-demanding. This work presents a novel framework based on hybrid 2D-3D convolutional neural networks (CNNs) to obtain continuous 3D retinal layer surfaces from OCT volumes, which works well with both full and sparse annotations. The 2D features of individual B-scans are extracted by an encoder consisting of 2D convolutions. These 2D features are then used to produce the alignment displacement vectors and layer segmentation by two 3D decoders coupled via a spatial transformer module. Two losses are proposed to utilize the retinal layers' natural property of being smooth for B-scan alignment and layer segmentation, respectively, and are the key to the semi-supervised learning with sparse annotation. The entire framework is trained end-to-end. To the best of our knowledge, this is the first work that attempts 3D retinal layer segmentation in volumetric OCT images based on CNNs. Experiments on a synthetic dataset and three public clinical datasets show that our framework can effectively align the B-scans for potential motion correction, and achieves superior performance to state-of-the-art 2D deep learning methods in terms of both layer segmentation accuracy and cross-B-scan 3D continuity in both fully and semi-supervised settings, thus offering more clinical values than previous works.

Automatic Segmentation of Retinal Layer in OCT Images with Choroidal Neovascularization.

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

Automated Segmentation of Choroidal Neovascularization on Optical Coherence Tomography Angiography Images of Neovascular Age-Related Macular Degeneration Patients Based on Deep Learning

Attention-guided Channel to Pixel Convolution Network for Retinal Layer Segmentation with Choroidal Neovascularization

Automatic Retinal Layer Segmentation of OCT Images with Central Serous Retinopathy.

Automatic Choroid Layer Segmentation from Optical Coherence Tomography Images Using Deep Learning

Fully Convolutional Network and Graph-Based Method for Co-Segmentation of Retinal Layer on Macular OCT Images.

Robust Layer Segmentation Against Complex Retinal Abnormalities for en face OCTA Generation

Automatic Segmentation and Visualization of Choroid in OCT with Knowledge Infused Deep Learning

Deep Learning Based Retinal Layer Segmentation in Optical Coherence Tomography Scans of Patients with Inherited Retinal Diseases

Automated Retinal Layers Segmentation in SD-OCT Images Using Dual-Gradient and Spatial Correlation Smoothness Constraint

Automatic Classification of Retinal Optical Coherence Tomography Images with Layer Guided Convolutional Neural Network

Automatic Choroid Layer Segmentation in OCT Images Via Context Efficient Adaptive Network.

DeepRetina: Layer Segmentation of Retina in OCT Images Using Deep Learning

Automated Retinal Layer Segmentation in Optical Coherence Tomography Images with Intraretinal Fluid

Deep Choroid Layer Segmentation Using Hybrid Features Extraction from OCT Images

Automated retinal layer segmentation on optical coherence tomography image by combination of structure interpolation and lateral mean filtering

Automated 3-D Retinal Layer Segmentation of Macular Optical Coherence Tomography Images with Serous Pigment Epithelial Detachments

Automatic Segmentation of Nine Retinal Layer Boundaries in OCT Images of Non-Exudative AMD Patients Using Deep Learning and Graph Search

Graph Attention U-Net for Retinal Layer Surface Detection and Choroid Neovascularization Segmentation in OCT Images

Automated Layer Segmentation of Macular OCT Images Via Graph-Based SLIC Superpixels and Manifold Ranking Approach