Abstract:Early screening and frequent monitoring effectively decrease the risk of severe scoliosis, but radiation exposure is a consequence of traditional radiograph examinations. Additionally, traditional X-ray images on the coronal or sagittal plane have difficulty providing three-dimensional (3-D) information on spinal deformities. The Scolioscan system provides an innovative 3-D spine imaging approach via ultrasonic scanning, and its feasibility has been demonstrated in numerous studies. In this paper, to further examine the potential of spinal ultrasonic data for describing 3-D spinal deformities, we propose a novel deep-learning tracker named Si-MSPDNet for extracting widely employed landmarks (spinous process (SP)) in ultrasonic images of spines and establish a 3-D spinal profile to measure 3-D spinal deformities. Si-MSPDNet has a Siamese architecture. First, we employ two efficient two-stage encoders to extract features from the uncropped ultrasonic image and the patch centered on the SP cut from the image. Then, a fusion block is designed to strengthen the communication between encoded features and further refine them from channel and spatial perspectives. The SP is a very small target in ultrasonic images, so its representation is weak in the highest-level feature maps. To overcome this, we ignore the highest-level feature maps and introduce parallel partial decoders to localize the SP. The correlation evaluation in the traditional Siamese network is also expanded to multiple scales to enhance cooperation. Furthermore, we propose a binary guided mask based on vertebral anatomical prior knowledge, which can further improve the performance of our tracker by highlighting the potential region with SP. The binary-guided mask is also utilized for fully automatic initialization in tracking. We collected spinal ultrasonic data and corresponding radiographs on the coronal and sagittal planes from 150 patients to evaluate the tracking precision of Si-MSPDNet and the performance of the generated 3-D spinal profile. Experimental results revealed that our tracker achieved a tracking success rate of 100% and a mean IoU of 0.882, outperforming some commonly used tracking and real-time detection models. Furthermore, a high correlation existed on both the coronal and sagittal planes between our projected spinal curve and that extracted from the spinal annotation in X-ray images. The correlation between the tracking results of the SP and their ground truths on other projected planes was also satisfactory. More importantly, the difference in mean curvatures was slight on all projected planes between tracking results and ground truths. Thus, this study effectively demonstrates the promising potential of our 3-D spinal profile extraction method for the 3-D measurement of spinal deformities using 3-D ultrasound data.

A Multi-Scale Keypoint Estimation Network with Self-Supervision for Spinal Curvature Assessment of Idiopathic Scoliosis from the Imperfect Dataset

Spinal Curve Assessment of Idiopathic Scoliosis with a Small Dataset Via a Multi-Scale Keypoint Estimation Approach

The Measurement of Cobb Angle Based on Spine X-ray Images Using Multi-Scale Convolutional Neural Network.

B-Spine: Learning B-Spline Curve Representation for Robust and Interpretable Spinal Curvature Estimation

Si-MSPDNet: A multiscale Siamese network with parallel partial decoders for the 3-D measurement of spines in 3D ultrasonic images

Automated Estimation of the Spinal Curvature via Spine Centerline Extraction with Ensembles of Cascaded Neural Networks

Automatic axial vertebral rotation estimation on radiographs for adolescent idiopathic scoliosis by deep learning

A New Method for Scoliosis Screening Incorporating Deep Learning With Back Images

An automated estimator for Cobb angle measurement using multi-task networks

A Landmark Estimation and Correction Network for Automated Measurement of Sagittal Spinal Parameters

A multi-stage ensemble network system to diagnose adolescent idiopathic scoliosis

Automatic Lenke classification of adolescent idiopathic scoliosis with deep learning

Development and validation of deep learning algorithms for scoliosis screening using back images

Symmetric Perception and Ordinal Regression for Detecting Scoliosis Natural Image

Intelligent Evaluation Method for Scoliosis at Home Using Back Photos Captured by Mobile Phones

Automatic spinal curvature measurement on ultrasound spine images using Faster R-CNN

Automated diagnosis of cervical spine physiological curvature based on deep neural networks with transformer by using nmODE

Anatomical prior based vertebra modelling for reappearance of human spines

Automated 3D Cobb Angle Measurement Using U-Net in CT Images of Preoperative Scoliosis Patients

Lenke Classification of Scoliosis Based on Segmentation Network and Adaptive Shape Descriptor

Automatic recognition of whole-spine sagittal alignment and curvature analysis through a deep learning technique