Abstract:Unet architectures are being investigated for automatic image segmentation of bones in CT scans because of their ability to address size-varying anatomies and pathological deformations. Nonetheless, changes in mineral density, narrowing of joint spaces and formation of largely irregular osteophytes may easily disrupt automatism requiring extensive manual refinement. A novel Unet variant, called CEL-Unet, is presented to boost the segmentation quality of the femur and tibia in the osteoarthritic knee joint. The neural network embeds region-aware and two contour-aware branches in the decoding path. The paper features three main technical novelties: 1) directed connections between contour and region branches progressively at different decoding scales; 2) pyramidal edge extraction in the contour branch to perform multi-resolution edge processing; 3) distance-weighted cross-entropy loss function to increase delineation quality at the sharp edges of the shapes. A set of 700 knee CT scans was used to train the model and test segmentation performance. Qualitatively CEL-Unet correctly segmented cases where the state-of-the-art architectures failed. Quantitatively, the Jaccard indexes of femur and tibia segmentation were 0.98 and 0.97, with median 3D reconstruction errors less than 0.80 and 0.60 mm, overcoming competitive Unet models. The results were evaluated against knee arthroplasty planning based on personalized surgical instruments (PSI). Excellent agreement with reference data was found for femoral (0.11°) and tibial (0.05°) alignments of the distal and proximal cuts computed on the reconstructed surfaces. The bone segmentation was effective for large pathological deformations and osteophytes, making the techniques potentially usable in PSI-based surgical planning, where the reconstruction accuracy of the bony shapes is one of the main critical factors for the success of the operation.

Automated Segmentation for Knee Joint MRI Images Using Hybrid UNet+Attention

Fully Automatic Knee Bone Detection and Segmentation on Three-Dimensional MRI

A Deep Learning-Based Method for Knee Articular Cartilage Segmentation in MRI Images

An Efficient Neural Network for Segmenting Multiple Joint Tissues From Knee MRI With Hyperparameter Optimization: Data From the Osteoarthritis Initiative

Knee Bone and Cartilage Segmentation Based on a 3D Deep Neural Network Using Adversarial Loss for Prior Shape Constraint

Automated anomaly-aware 3D segmentation of bones and cartilages in knee MR images from the Osteoarthritis Initiative

Region‐based Two‐stage MRI Bone Tissue Segmentation of the Knee Joint

A Feasibility Study of Knee Joint Semantic Segmentation on 3D MR Images

Auto-segmentation of the tibia and femur from knee MR images via deep learning and its application to cartilage strain and recovery

Segmentation of tibiofemoral joint tissues from knee MRI using MtRA-Unet and incorporating shape information: Data from the Osteoarthritis Initiative

CEL-Unet: a novel CNN architecture for 3D Segmentation of Knee Bones affected by Severe Osteoarthritis for PSI-Based Surgical Planning

Automatic multi-structure pediatric knee bone segmentation using optimal multi-level Otsu thresholding to tackle intensity homogeneity in bone structures

Joint reconstruction and segmentation in undersampled 3D knee MRI combining shape knowledge and deep learning

KCB-Net: A 3D knee cartilage and bone segmentation network via sparse annotation

Prior-based 3D U-Net: A Model for Knee-Cartilage Segmentation in MRI Images

Detection Method of Athlete Joint Injury Based on Deep Learning Model

Enhanced Attention Res-Unet for Segmentation of Knee Bones

2D-3D Hierarchical Feature Fusion Network for Segmentation of Bone Structure in Knee Mr Image

Comparative Analysis of Convolutional Neural Network Architectures for Automated Knee Segmentation in Medical Imaging: A Performance Evaluation

CEL-Unet: Distance Weighted Maps and Multi-Scale Pyramidal Edge Extraction for Accurate Osteoarthritic Bone Segmentation in CT Scans

Automated Segmentation of Trabecular and Cortical Bone from Proton Density Weighted MRI of the Knee