Abstract:Layer segmentation is important to quantitative analysis of retinal optical coherence tomography (OCT). Recently, deep learning based methods have been developed to automate this task and yield remarkable performance. However, due to the large spatial gap and potential mismatch between the B-scans of an OCT volume, all of them were based on 2D segmentation of individual B-scans, which may lose the continuity and diagnostic information of the retinal layers in 3D space. Besides, most of these methods required dense annotation of the OCT volumes, which is labor-intensive and expertise-demanding. This work presents a novel framework based on hybrid 2D-3D convolutional neural networks (CNNs) to obtain continuous 3D retinal layer surfaces from OCT volumes, which works well with both full and sparse annotations. The 2D features of individual B-scans are extracted by an encoder consisting of 2D convolutions. These 2D features are then used to produce the alignment displacement vectors and layer segmentation by two 3D decoders coupled via a spatial transformer module. Two losses are proposed to utilize the retinal layers' natural property of being smooth for B-scan alignment and layer segmentation, respectively, and are the key to the semi-supervised learning with sparse annotation. The entire framework is trained end-to-end. To the best of our knowledge, this is the first work that attempts 3D retinal layer segmentation in volumetric OCT images based on CNNs. Experiments on a synthetic dataset and three public clinical datasets show that our framework can effectively align the B-scans for potential motion correction, and achieves superior performance to state-of-the-art 2D deep learning methods in terms of both layer segmentation accuracy and cross-B-scan 3D continuity in both fully and semi-supervised settings, thus offering more clinical values than previous works.

Layer Structures Localization in Optical Coherence Tomography Images

Enhancement and Quantitative Measurement of Layer Structures in Optical Coherence Tomographic Images

Improved Sparse Representation Algorithm for Optical Coherence Tomography Images

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

A New Method to Remove Dithering in Optical Coherence Tomography Without Information Loss

Confidence-Guided Topology-Preserving Layer Segmentation for Optical Coherence Tomography Images With Focus-Column Module

High Performance OCTA Enabled by Combining Features of Shape, Intensity, and Complex Decorrelation

Inter-frame information based choroid segmentation in enhanced optical coherence tomography images

Noise Redistribution and 3D Shearlet Filtering for Speckle Reduction in Optical Coherence Tomography

Speckle Reduction in Optical Coherence Tomography by Image Registration and Matrix Completion

A Deep Convolutional Feature Based Learning Layer-Specific Edges Method for Segmenting OCT Image

Speckle Reduction of OCT Via Super Resolution Reconstruction and Its Application on Retinal Layer Segmentation

Computational approach for correcting defocus and suppressing speckle noise in line-field optical coherence tomography images

Automated Layer Segmentation of Retinal Optical Coherence Tomography Images Using a Deep Feature Enhanced Structured Random Forests Classifier

Noise Reduction for SD-OCT Using a Structure-Preserving Domain Transfer Approach

Deep learning-based image enhancement in optical coherence tomography by exploiting interference fringe

Speckle Reduction in Optical Coherence Tomography by Matrix Completion Using Bilateral Random Projection

Speckle Reduction in Optical Coherence Tomography Via Super-Resolution Reconstruction

Automated Layer Segmentation of Macular OCT Images Via Graph-Based SLIC Superpixels and Manifold Ranking Approach

Intra-retinal Layers Segmentation of Macular OCT Images Based on the Graph Optimal Approach

Automated Segmentation of Retinal Layers from Optical Coherent Tomography Images Using Geodesic Distance