Abstract:Abstract Aims Glioblastoma multiforme (GBM) is an aggressive brain malignancy. Performance status is an important prognostic factor but is subjectively evaluated, resulting in inaccuracy. Objective markers of frailty/physical condition, such as measures of skeletal muscle mass can be evaluated on cross-sectional imaging and is associated with cancer survival. In GBM, temporalis muscle has been identified as a skeletal muscle mass surrogate and a prognostic factor. However, current manual muscle quantification is time consuming, limiting clinical adoption. We previously developed a deep learning system for automated temporalis muscle quantification, with high accuracy (Dice coefficient 0.912), and showed muscle cross-sectional area is independently significantly associated with survival in GBM (HR 0.380). However, it required manual selection of the temporalis muscle-containing MRI slice. Thus, in this work we aimed to develop a fully automatic deep-learning system, using the eyeball as an anatomic landmark for automatic slice selection, to quantify temporalis and validate on independent datasets. Method 3D brain MRI scans were obtained from four datasets: our in-house glioblastoma patient dataset, TCGA-GBM, IVY-GAP and REMBRANDT. Manual eyeball and temporalis segmentations were performed on 2D MRI images by two experienced readers. Two neural networks (2D U-Nets) were trained, one to automatically segment the eyeball and the other to segment the temporalis muscle on 2D MRI images using Dice loss function. The cross sectional area of eyeball segmentations were quantified and thresholded, to select the superior orbital MRI slice from each scan. This slice underwent temporalis segmentation, whose cross sectional area was then quantified. Accuracy of automatically predicted eyeball and temporalis segmentations were compared to manual ground truth segmentations on metrics of Dice coefficient, precision, recall and Hausdorff distance. Accuracy of MRI slice selection (by the eyeball segmentation model) for temporalis segmentation was determined by comparing automatically selected slices to slices selected manually by a trained neuro-oncologist. Results 398 images from 185 patients and 366 images from 145 patients were used for the eyeball and temporalis segmentation models, respectively. 61 independent TCGA-GBM scans formed a validation cohort to assess the performance of the full pipeline. The model achieved high accuracy in eyeball segmentation, with test set Dice coefficient of 0.9029 ± 0.0894, precision of 0.8842 ± 0.0992, recall of 0.9297 ± 0.6020 and Hausdorff distance of 2.8847 ± 0.6020. High segmentation accuracy was also achieved by the temporalis segmentation model, with Dice coefficient of 0.8968 ± 0.0375, precision of 0.8877 ± 0.0679, recall of 0.9118 ± 0.0505 and Hausdorff distance of 1.8232 ± 0.3263 in the test set. 96.1% of automatically selected slices for temporalis segmentation were within 2 slices of the manually selected slice. Conclusion Temporalis muscle cross-sectional area can be rapidly and accurately assessed from 3D MRI brain scans using a deep learning-based system in a fully automated pipeline. Combined with our and others’ previous results that demonstrate the prognostic significance of temporalis cross-sectional area and muscle width, our findings suggest a role for deep learning in muscle mass and sarcopenia screening in GBM, with the potential to add significant value to routine imaging. Possible clinical applications include risk profiling, treatment stratification and informing interventions for muscle preservation. Further work will be to validate the prognostic value of temporalis muscle cross sectional area measurements generated by our fully automatic deep learning system in the multiple in-house and external datasets.

Development of an initial training and evaluation programme for manual lower limb muscle MRI segmentation

Quantitative MRI outcome measures in CMT1A using automated lower limb muscle segmentation

Automatic Segmentation of Muscle Tissue and Inter-muscular Fat in Thigh and Calf MRI Images

A Deep-Learning-Based, Fully Automated Program to Segment and Quantify Major Spinal Components on Axial Lumbar Spine Magnetic Resonance Images

A Deep Learning Model to Automate Skeletal Muscle Area Measurement on Computed Tomography Images

Automated postoperative muscle assessment of hip arthroplasty patients using multimodal imaging joint segmentation

A comparative study of two automated solutions for cross-sectional skeletal muscle measurement from abdominal computed tomography images

Transfer learning for data-efficient abdominal muscle segmentation with convolutional neural networks

Comparison of Manual vs Artificial Intelligence-Based Muscle MRI Segmentation for Evaluating Disease Progression in Patients With CMT1A

Pixel-Level Deep Segmentation: Artificial Intelligence Quantifies Muscle on Computed Tomography for Body Morphometric Analysis

The Impact of Fatty Infiltration on MRI Segmentation of Lower Limb Muscles in Neuromuscular Diseases: A Comparative Study of Deep Learning Approaches

A novel mean shape based post-processing method for enhancing deep learning lower-limb muscle segmentation accuracy

Development of a deep learning-based fully automated segmentation of rotator cuff muscles from clinical MR scans

Deep Learning for Automatic Segmentation of Paraspinal Muscle on Computed Tomography

Fully automated deep learning system for detecting sarcopenia on brain MRI in glioblastoma

Deep learning-based automatic pipeline for quantitative assessment of thigh muscle morphology and fatty infiltration

Efficient data labeling strategies for automated muscle segmentation in lower leg MRIs of Charcot-Marie-Tooth disease patients

Evaluation of the reliability of measuring lower back muscles cross-sectional area based on manual segmentation within multi-level MRI images

Deep learning segmentation of transverse musculoskeletal ultrasound images for neuromuscular disease assessment

Healthy versus pathological learning transferability in shoulder muscle MRI segmentation using deep convolutional encoder-decoders

External validation of a deep learning model for automatic segmentation of skeletal muscle and adipose tissue on abdominal computed tomography images