Abstract:Layer segmentation is important to quantitative analysis of retinal optical coherence tomography (OCT). Recently, deep learning based methods have been developed to automate this task and yield remarkable performance. However, due to the large spatial gap and potential mismatch between the B-scans of an OCT volume, all of them were based on 2D segmentation of individual B-scans, which may lose the continuity and diagnostic information of the retinal layers in 3D space. Besides, most of these methods required dense annotation of the OCT volumes, which is labor-intensive and expertise-demanding. This work presents a novel framework based on hybrid 2D-3D convolutional neural networks (CNNs) to obtain continuous 3D retinal layer surfaces from OCT volumes, which works well with both full and sparse annotations. The 2D features of individual B-scans are extracted by an encoder consisting of 2D convolutions. These 2D features are then used to produce the alignment displacement vectors and layer segmentation by two 3D decoders coupled via a spatial transformer module. Two losses are proposed to utilize the retinal layers' natural property of being smooth for B-scan alignment and layer segmentation, respectively, and are the key to the semi-supervised learning with sparse annotation. The entire framework is trained end-to-end. To the best of our knowledge, this is the first work that attempts 3D retinal layer segmentation in volumetric OCT images based on CNNs. Experiments on a synthetic dataset and three public clinical datasets show that our framework can effectively align the B-scans for potential motion correction, and achieves superior performance to state-of-the-art 2D deep learning methods in terms of both layer segmentation accuracy and cross-B-scan 3D continuity in both fully and semi-supervised settings, thus offering more clinical values than previous works.

Model-Informed Deep Learning for Surface Segmentation in Medical Imaging.

Globally Optimal Surface Segmentation using Deep Learning with Learnable Smoothness Priors

Globally Optimal Segmentation of Mutually Interacting Surfaces using Deep Learning

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

Deep Neural Networks for Surface Segmentation Meet Conditional Random Fields

CM-SegNet: A Deep Learning-Based Automatic Segmentation Approach for Medical Images by Combining Convolution and Multilayer Perceptron

Region-to-boundary deep learning model with multi-scale feature fusion for medical image segmentation

Deep Learning-Based Image Segmentation on Multimodal Medical Imaging

Advances in Medical Image Segmentation: A Comprehensive Review of Traditional, Deep Learning and Hybrid Approaches

Semantic-Based Optimization of Deep Learning for Efficient Real-Time Medical Image Segmentation

MIDeepSeg: Minimally interactive segmentation of unseen objects from medical images using deep learning

A Novel Deep Learning Model for Medical Image Segmentation with Convolutional Neural Network and Transformer

Deep Active Contour Network for Medical Image Segmentation.

Multichannel convolutional neural network-based fuzzy active contour model for medical image segmentation

Brain Surface Reconstruction from MRI Images Based on Segmentation Networks Applying Signed Distance Maps

Dendritic Deep Learning for Medical Segmentation

Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation

One Network to Segment Them All: A General, Lightweight System for Accurate 3D Medical Image Segmentation

Deep Neural Network for 3D Surface Segmentation based on Contour Tree Hierarchy

Certification of Deep Learning Models for Medical Image Segmentation

MSKD: Structured knowledge distillation for efficient medical image segmentation