Abstract:Early screening and frequent monitoring effectively decrease the risk of severe scoliosis, but radiation exposure is a consequence of traditional radiograph examinations. Additionally, traditional X-ray images on the coronal or sagittal plane have difficulty providing three-dimensional (3-D) information on spinal deformities. The Scolioscan system provides an innovative 3-D spine imaging approach via ultrasonic scanning, and its feasibility has been demonstrated in numerous studies. In this paper, to further examine the potential of spinal ultrasonic data for describing 3-D spinal deformities, we propose a novel deep-learning tracker named Si-MSPDNet for extracting widely employed landmarks (spinous process (SP)) in ultrasonic images of spines and establish a 3-D spinal profile to measure 3-D spinal deformities. Si-MSPDNet has a Siamese architecture. First, we employ two efficient two-stage encoders to extract features from the uncropped ultrasonic image and the patch centered on the SP cut from the image. Then, a fusion block is designed to strengthen the communication between encoded features and further refine them from channel and spatial perspectives. The SP is a very small target in ultrasonic images, so its representation is weak in the highest-level feature maps. To overcome this, we ignore the highest-level feature maps and introduce parallel partial decoders to localize the SP. The correlation evaluation in the traditional Siamese network is also expanded to multiple scales to enhance cooperation. Furthermore, we propose a binary guided mask based on vertebral anatomical prior knowledge, which can further improve the performance of our tracker by highlighting the potential region with SP. The binary-guided mask is also utilized for fully automatic initialization in tracking. We collected spinal ultrasonic data and corresponding radiographs on the coronal and sagittal planes from 150 patients to evaluate the tracking precision of Si-MSPDNet and the performance of the generated 3-D spinal profile. Experimental results revealed that our tracker achieved a tracking success rate of 100% and a mean IoU of 0.882, outperforming some commonly used tracking and real-time detection models. Furthermore, a high correlation existed on both the coronal and sagittal planes between our projected spinal curve and that extracted from the spinal annotation in X-ray images. The correlation between the tracking results of the SP and their ground truths on other projected planes was also satisfactory. More importantly, the difference in mean curvatures was slight on all projected planes between tracking results and ground truths. Thus, this study effectively demonstrates the promising potential of our 3-D spinal profile extraction method for the 3-D measurement of spinal deformities using 3-D ultrasound data.

A Dual Coordinate System Vertebra Landmark Detection Network with Sparse-to-Dense Vertebral Line Interpolation

The Measurement of Cobb Angle Based on Spine X-ray Images Using Multi-Scale Convolutional Neural Network.

Anatomical Prior-Based Vertebral Landmark Detection for Spinal Disorder Diagnosis

Part Affinity Fields and CoordConv for Detecting Landmarks of Lumbar Vertebrae and Sacrum in X-ray Images

A Landmark Estimation and Correction Network for Automated Measurement of Sagittal Spinal Parameters

Accurate Scoliosis Vertebral Landmark Localization on X-ray Images Via Shape-constrained Multi-stage Cascaded CNNs.

Automated vertebral landmarks and spinal curvature estimation using non-directional part affinity fields

Dual-task ultrasound spine transverse vertebrae segmentation network with contour regularization

Exploring Neighbor Spatial Relationships for Enhanced Lumbar Vertebrae Detection in X-ray Images

Accurate Cobb Angle Estimation on Scoliosis X-Ray Images Via Deeply-Coupled Two-Stage Network with Differentiable Cropping and Random Perturbation

Bipartite Distance for Shape-Aware Landmark Detection in Spinal X-Ray Images

Vertebrae Labeling via End-to-End Integral Regression Localization and Multi-Label Classification Network

Si-MSPDNet: A multiscale Siamese network with parallel partial decoders for the 3-D measurement of spines in 3D ultrasonic images

Automatic Vertebra Labeling in Large-Scale 3D CT using Deep Image-to-Image Network with Message Passing and Sparsity Regularization

An automated estimator for Cobb angle measurement using multi-task networks

Symmetric Perception and Ordinal Regression for Detecting Scoliosis Natural Image

Sequence based local–global information fusion framework for vertebrae detection under pathological and FOV variation challenges

VertNet: Accurate Vertebra Localization and Identification Network from CT Images

Joint Spinal Centerline Extraction and Curvature Estimation with Row-Wise Classification and Curve Graph Network

An Automated and Accurate Spine Curve Analysis System

Automatic recognition of whole-spine sagittal alignment and curvature analysis through a deep learning technique