Abstract:PURPOSE: To describe and evaluate a new segmentation method using deep convolutional neural network (CNN), 3D fully connected conditional random field (CRF), and 3D simplex deformable modeling to improve the efficiency and accuracy of knee joint tissue segmentation.METHODS: A segmentation pipeline was built by combining a semantic segmentation CNN, 3D fully connected CRF, and 3D simplex deformable modeling. A convolutional encoder-decoder network was designed as the core of the segmentation method to perform high resolution pixel-wise multi-class tissue classification for 12 different joint structures. The 3D fully connected CRF was applied to regularize contextual relationship among voxels within the same tissue class and between different classes. The 3D simplex deformable modeling refined the output from 3D CRF to preserve the overall shape and maintain a desirable smooth surface for joint structures. The method was evaluated on 3D fast spin-echo (3D-FSE) MR image data sets. Quantitative morphological metrics were used to evaluate the accuracy and robustness of the method in comparison to the ground truth data.RESULTS: The proposed segmentation method provided good performance for segmenting all knee joint structures. There were 4 tissue types with high mean Dice coefficient above 0.9 including the femur, tibia, muscle, and other non-specified tissues. There were 7 tissue types with mean Dice coefficient between 0.8 and 0.9 including the femoral cartilage, tibial cartilage, patella, patellar cartilage, meniscus, quadriceps and patellar tendon, and infrapatellar fat pad. There was 1 tissue type with mean Dice coefficient between 0.7 and 0.8 for joint effusion and Baker's cyst. Most musculoskeletal tissues had a mean value of average symmetric surface distance below 1 mm.CONCLUSION: The combined CNN, 3D fully connected CRF, and 3D deformable modeling approach was well-suited for performing rapid and accurate comprehensive tissue segmentation of the knee joint. The deep learning-based segmentation method has promising potential applications in musculoskeletal imaging.

Skeleton-guided 3D convolutional neural network for tubular structure segmentation

A Lightweight Deep Network for 3D Medical Image Segmentation.

Dynamic Snake Convolution based on Topological Geometric Constraints for Tubular Structure Segmentation

A 3D Convolutional Neural Network for Volumetric Image Semantic Segmentation

Deep Distance Transform for Tubular Structure Segmentation in CT Scans

Tubule segmentation of fluorescence microscopy images based on convolutional neural networks with inhomogeneity correction

Tubular Structure Segmentation via Multi-Scale Reverse Attention Sparse Convolution

Deep Sequential Segmentation of Organs in Volumetric Medical Scans

A Shape-Supervised Feature Fusion U-Net for Tubular Structure Segmentation

CylinGCN: Cylindrical structures segmentation in 3D biomedical optical imaging by a contour-based graph convolutional network

Segmentation of Lung Nodules on CT Images Using a Nested Three-Dimensional Fully Connected Convolutional Network

Self-Supervised Learning of Skeleton-Aware Morphological Representation for 3D Neuron Segments

CS2-Net: Deep Learning Segmentation of Curvilinear Structures in Medical Imaging

A 3D Coarse-to-Fine Framework for Volumetric Medical Image Segmentation

An application of cascaded 3D fully convolutional networks for medical image segmentation

Three-Dimensional Feature-Enhanced Network for Automatic Femur Segmentation

Deep convolutional neural network for segmentation of knee joint anatomy

Latent3DU-net: Multi-level Latent Shape Space Constrained 3D U-net for Automatic Segmentation of the Proximal Femur from Radial MRI of the Hip

Knee Bone and Cartilage Segmentation Based on a 3D Deep Neural Network Using Adversarial Loss for Prior Shape Constraint

Deep Learning Approaches for Imaging-Based Automated Segmentation of Tuberous Sclerosis Complex

Automatic Segmentation of Temporal Bone Structures from Clinical Conventional CT Using a CNN Approach