Abstract:Background: Scoliosis is a type of spinal deformity, which is harmful to a person's health. In severe cases, it can trigger paralysis or death. The measurement of Cobb angle plays an essential role in assessing the severity of scoliosis. Purpose: The aim of this paper is to propose an automatic system for landmark detection and Cobb angle estimation, which can effectively help clinicians diagnose and treat scoliosis. Methods: A novel hybrid framework was proposed to measure Cobb angle precisely for clinical diagnosis, which was referred as W-Transformer due to its w-shaped architecture. First, a convolutional neural network of cascade residual blocks as our backbone was designed. Then a transformer was fused to learn the dependency information between spine and landmarks. In addition, a reinforcement branch was designed to improve the overlap of landmarks, and an improved prediction module was proposed to fine-tune the final coordinates of landmarks in Cobb angles estimation. Besides, the public Accurate Automated Spinal Curvature Estimation (AASCE) MICCAI 2019 challenge was served as data set. It supplies 609 manually labeled spine anterior-posterior (AP) X-ray images, each of which contains a total of 68 landmark labels and three Cobb Angles tags. Results: From the perspective of the AASCE MICCAI 2019 challenge, we achieved a lower symmetric mean absolute percentage error (SMAPE) of 8.26% for all Cobb angles and the lowest averaged detection error of 50.89 in terms of landmark detection, compared with many state-of-the-art methods. We also provided the SMAPEs for the Cobb angles of the proximal-thoracic (PT), the main-thoracic (MT), and the thoracic-lumbar (TL) area, which are 5.27%, 14.59%, and 20.97% respectively, however, these data were not covered in most previous studies. Statistical analysis demonstrates that our model has obtained a high level of Pearson correlation coefficient of 0.9398 ( p < 0.001 $p<0.001$ ), which shows excellent reliability of our model. Our model can yield 0.9489 ( p < 0.001 $p<0.001$ ), 0.8817 ( p < 0.001 $p<0.001$ ), and 0.9149 ( p < 0.001 $p<0.001$ ) for PT, MT, and TL, respectively. The overall variability of Cobb angle measurement is less than 4 ∘ $^\circ$ , implying clinical value. And the mean absolute deviation (standard deviation) for three regions is 3.64 ∘ $^\circ$ (4.13 ∘ $^\circ$ ), 3.84 ∘ $^\circ$ (4.66 ∘ $^\circ$ ), and 3.80 ∘ $^\circ$ (4.19 ∘ $^\circ$ ). The results of Student paired t $t$ -test indicate that no statistically significant differences are observed between manual measurement and our automatic approach ( p $p$ -value is always > $>$ 0.05). Regarding the diagnosis of scoliosis (Cobb angle > $>$ 10 ∘ $^\circ$ ), the proposed method achieves a high sensitivity of 0.9577 and a specificity of 0.8475 for all spinal regions. Conclusions: This study offers a brand-new automatic approach that is potentially of great benefit of the complex task of landmark detection and Cobb angle evaluation, which can provide helpful navigation information about the early diagnosis of scoliosis.

Accurate Automated Cobb Angles Estimation Using Multi-View Extrapolation Net.

The Measurement of Cobb Angle Based on Spine X-ray Images Using Multi-Scale Convolutional Neural Network.

Accurate Cobb Angle Estimation on Scoliosis X-Ray Images Via Deeply-Coupled Two-Stage Network with Differentiable Cropping and Random Perturbation

MPF-net: an Effective Framework for Automated Cobb Angle Estimation

An Automated and Accurate Spine Curve Analysis System

An automated estimator for Cobb angle measurement using multi-task networks

Automated 3D Cobb Angle Measurement Using U-Net in CT Images of Preoperative Scoliosis Patients

An Automated Cobb Angle Estimation Method Using Convolutional Neural Network with Area Limitation

Direct Estimation of Spinal Cobb Angles by Structured Multi-Output Regression

Cobb Angle Measurement Method of Scoliosis Based on U-net Network

Automatic Cobb angle measurement method based on vertebra segmentation by deep learning

Spinal Curve Guide Network (SCG-Net) for Accurate Automated Spinal Curvature Estimation

Automating Cobb Angle Measurement for Adolescent Idiopathic Scoliosis using Instance Segmentation

A Landmark-aware Network for Automated Cobb Angle Estimation Using X-ray Images

MMA-Net: Multiple Morphology-Aware Network for Automated Cobb Angle Measurement

Automatic Measurement of Scoliosis based on an Improved Segmentation Model

Deep learning automates Cobb angle measurement compared with multi-expert observers

W-Transformer: Accurate Cobb angles estimation by using a transformer-based hybrid structure

Automatic Measurement Algorithm of Scoliosis Cobb Angle Based on Deep Learning

Automated Cobb Angle Measurement for Adolescent Idiopathic Scoliosis Using Convolutional Neural Network

Cobb Angle Measurement of Spine from X-Ray Images Using Convolutional Neural Network