Abstract:Background and objective: In patients treated with hip arthroplasty, the muscular condition and presence of inflammatory reactions are assessed using magnetic resonance imaging (MRI). As MRI lacks contrast for bony structures, computed tomography (CT) is preferred for clinical evaluation of bone tissue and orthopaedic surgical planning. Combining the complementary information of MRI and CT could improve current clinical practice for diagnosis, monitoring and treatment planning. In particular, the different contrast of these modalities could help better quantify the presence of fatty infiltration to characterise muscular condition and assess implant failure. In this work, we combine CT and MRI for joint bone and muscle segmentation and we propose a novel Intramuscular Fat Fraction estimation method for the quantification of muscle atrophy. Methods: Our multimodal framework is able to segment healthy and pathological musculoskeletal structures as well as implants, and develops into three steps. First, input images are pre-processed to improve the low quality of clinically acquired images and to reduce the noise associated with metal artefact. Subsequently, CT and MRI are non-linearly aligned using a novel approach which imposes rigidity constraints on bony structures to ensure realistic deformation. Finally, taking advantage of a multimodal atlas we created for this task, a multi-atlas based segmentation delineates pelvic bones, abductor muscles and implants on both modalities jointly. From the obtained segmentation, a multimodal estimation of the Intramuscular Fat Fraction can be automatically derived. Results: Evaluation of the segmentation in a leave-one-out cross-validation study on 22 hip sides resulted in an average Dice score of 0.90 for skeletal and 0.84 for muscular structures. Our multimodal Intramuscular Fat Fraction was benchmarked on 27 different cases against a standard radiological score, showing stronger association than a single modality approach in a one-way ANOVA F-test analysis. Conclusions: The proposed framework represents a promising tool to support image analysis in hip arthroplasty, being robust to the presence of implants and associated image artefacts. By allowing for the automated extraction of a muscle atrophy imaging biomarker, it could quantitatively inform the decision-making process about patient's management.

Automated regional analysis of B-mode ultrasound images of skeletal muscle movement

A Hybrid Method for Ultrasound-Based Tracking of Skeletal Muscle Architecture

Automated Method for Tracking Human Muscle Architecture on Ultrasound Scans during Dynamic Tasks

Automatic Tracking of Aponeuroses and Estimation of Muscle Thickness in Ultrasonography: a Feasibility Study.

Spatio-temporal Active Region Model for Simultaneous Segmentation and Motion Estimation of the Whole Heart

Estimation of absolute states of human skeletal muscle via standard B-mode ultrasound imaging and deep convolutional neural networks

Continuous detection of muscle aspect ratio using keypoint tracking in ultrasonography.

A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images

Simple Muscle Architecture Analysis (SMA): an ImageJ macro tool to automate measurements in B-mode ultrasound scans

Automatic Analysis of Transverse Musculoskeletal Ultrasound Images Based on the Multi-Task Learning Model

Joint Analysis of Heart Geometry and Kinematics with Spatiotemporal Active Region Model

Robust Thickness Measure in Ultrasound Image Sequences: A Novel Active Contour Tracking Method for Characterizing Muscle Fatigue

Machine Learning-Based Pixel-Level Quantification of Intramuscular Connective Tissue using Ultrasound Texture Analysis

A methodological approach for collecting simultaneous measures of muscle, aponeurosis, and tendon behaviour during dynamic contractions

In plane quantification of in vivo muscle elastic anisotropy factor by steered ultrasound pushing beams

Automatic Muscle Fiber Orientation Tracking in Ultrasound Images Using a New Adaptive Fading Bayesian Kalman Smoother

3D ultrasound-based determination of skeletal muscle fascicle orientations

Automated postoperative muscle assessment of hip arthroplasty patients using multimodal imaging joint segmentation

A Clustering-Based Method for Estimating Pennation Angle from B-mode Ultrasound Images

Automatic tracking of muscle fascicle orientation in ultrasound images: a approach based on a normalized Radon transform and statistical measure