Abstract:Musculoskeletal ultrasound imaging is an important basis for the early screening and accurate treatment of muscle disorders. It allows the observation of muscle status to screen for underlying neuromuscular diseases including myasthenia gravis, myotonic dystrophy, and ankylosing muscular dystrophy. Due to the complexity of skeletal muscle ultrasound image noise, it is a tedious and time-consuming process to analyze. Therefore, we proposed a multi-task learning-based approach to automatically segment and initially diagnose transverse musculoskeletal ultrasound images. The method implements muscle cross-sectional area (CSA) segmentation and abnormal muscle classification by constructing a multi-task model based on multi-scale fusion and attention mechanisms (MMA-Net). The model exploits the correlation between tasks by sharing a part of the shallow network and adding connections to exchange information in the deep network. The multi-scale feature fusion module and attention mechanism were added to MMA-Net to increase the receptive field and enhance the feature extraction ability. Experiments were conducted using a total of 1827 medial gastrocnemius ultrasound images from multiple subjects. Ten percent of the samples were randomly selected for testing, 10% as the validation set, and the remaining 80% as the training set. The results show that the proposed network structure and the added modules are effective. Compared with advanced single-task models and existing analysis methods, our method has a better performance at classification and segmentation. The mean Dice coefficients and IoU of muscle cross-sectional area segmentation were 96.74% and 94.10%, respectively. The accuracy and recall of abnormal muscle classification were 95.60% and 94.96%. The proposed method achieves convenient and accurate analysis of transverse musculoskeletal ultrasound images, which can assist physicians in the diagnosis and treatment of muscle diseases from multiple perspectives.

Estimation of absolute states of human skeletal muscle via standard B-mode ultrasound imaging and deep convolutional neural networks

Quantifying skeletal muscle structure parameters in ultrasound images using deep learning without linear assumptions

SonoMyoNet: A Convolutional Neural Network for Predicting Isometric Force From Highly Sparse Ultrasound Images

Automated regional analysis of B-mode ultrasound images of skeletal muscle movement

Automatic Quantitative Assessment of Muscle Strength Based on Deep Learning and Ultrasound.

Deep learning segmentation of transverse musculoskeletal ultrasound images for neuromuscular disease assessment

Distributed Wearable Ultrasound Sensors Predict Isometric Ground Reaction Force

Improved Fascicle Length Estimates From Ultrasound Using a U-net-LSTM Framework

Wearable Ultrasound System for Assessing Muscle Function During Physical Activity

The bionic neural network for external simulation of human locomotor system

Estimation of electrical muscle activity during gait using inertial measurement units with convolution attention neural network and small-scale dataset

A Hybrid Method for Ultrasound-Based Tracking of Skeletal Muscle Architecture

Deep Learning of Ultrasound Imaging for Evaluating Ambulatory Function of Individuals with Duchenne Muscular Dystrophy

A deep learning method to predict ankle joint moment during walking at different speeds with ultrasound imaging: A framework for assistive devices control

Continuous Estimation of the Lower-Limb Multi-Joint Angles Based on Muscle Synergy Theory and State-Space Model

Muscle Cross-Sectional Area Segmentation in Transverse Ultrasound Images Using Vision Transformers

Automatic Analysis of Transverse Musculoskeletal Ultrasound Images Based on the Multi-Task Learning Model

A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images

Predicting Muscle Thickness Deformation from Muscle Activation Patterns: A Dual-Attention Framework

Estimation of joint torque in dynamic activities using wearable A-mode ultrasound

Deep learning for the rapid automatic segmentation of forearm muscle boundaries from ultrasound datasets