Abstract:Background: Skeletal muscle segmentation is an important procedure for assessing sarcopenia, an emerging imaging biomarker of patient frailty. Data annotation remains the bottleneck for training deep learning auto-segmentation models. Purpose: There is a need to define methodologies for applying models to different domains (e.g., anatomical regions or imaging modalities) without dramatically increasing data annotation. Methods: To address this problem, we empirically evaluate the generalizability of various source tasks for transfer learning: natural image classification, natural image segmentation, unsupervised image reconstruction, and self-supervised jigsaw solving. Axial CT slices at L3 were extracted from PET-CT scans for 204 oesophago-gastric cancer patients and the skeletal muscle manually delineated by an expert. Features were transferred and segmentation models trained on subsets ( n = 5 , 10 , 25 , 50 , 75 , 100 , 125 $n=5,10,25,50,75,100,125$ ) of the manually annotated training set. Four-fold cross-validation was performed to evaluate model generalizability. Human-level performance was established by performing an inter-observer study consisting of ten trained radiographers. Results: We find that accurate segmentation models can be trained on a fraction of the data required by current approaches. The Dice similarity coefficient and root mean square distance-to-agreement were calculated for each prediction and used to assess model performance. Models pre-trained on a segmentation task and fine-tuned on 10 images produce delineations that are comparable to those from trained observers and extract reliable measures of muscle health. Conclusions: Appropriate transfer learning can generate convolutional neural networks for abdominal muscle segmentation that achieve human-level performance while decreasing the required data by an order of magnitude, compared to previous methods ( n = 160 → 10 $n=160 \rightarrow 10$ ). This work enables the development of future models for assessing skeletal muscle at other anatomical sites where large annotated data sets are scarce and clinical needs are yet to be addressed.

Semi-automatic muscle segmentation in MR images using deep registration-based label propagation

Multi-Task, Multi-Domain Deep Segmentation with Shared Representations and Contrastive Regularization for Sparse Pediatric Datasets

Efficient data labeling strategies for automated muscle segmentation in lower leg MRIs of Charcot-Marie-Tooth disease patients

Multi-structure bone segmentation in pediatric MR images with combined regularization from shape priors and adversarial network

Healthy versus pathological learning transferability in shoulder muscle MRI segmentation using deep convolutional encoder-decoders

Semi-Supervised Deep Learning for Multi-Tissue Segmentation from Multi-Contrast MRI

Pixel-Level Deep Segmentation: Artificial Intelligence Quantifies Muscle on Computed Tomography for Body Morphometric Analysis

Generalizable multi-task, multi-domain deep segmentation of sparse pediatric imaging datasets via multi-scale contrastive regularization and multi-joint anatomical priors

Collaborative Learning for Annotation-Efficient Volumetric MR Image Segmentation

DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentation

Fully automated 3D segmentation of MR-imaged calf muscle compartments: Neighborhood relationship enhanced fully convolutional network

Transfer learning for data-efficient abdominal muscle segmentation with convolutional neural networks

Automatic Segmentation of Muscle Tissue and Inter-muscular Fat in Thigh and Calf MRI Images

Deep learning segmentation of transverse musculoskeletal ultrasound images for neuromuscular disease assessment

A novel mean shape based post-processing method for enhancing deep learning lower-limb muscle segmentation accuracy

Deep network and multi-atlas segmentation fusion for delineation of thigh muscle groups in three-dimensional water-fat separated MRI

DeepMRSeg: A convolutional deep neural network for anatomy and abnormality segmentation on MR images

IFSS-Net: Interactive Few-Shot Siamese Network for Faster Muscle Segmentation and Propagation in Volumetric Ultrasound

Deep learning for the rapid automatic segmentation of forearm muscle boundaries from ultrasound datasets

Semi-Supervised and Self-Supervised Collaborative Learning for Prostate 3D MR Image Segmentation