Abstract:Human skeletal development is continuous and staged, and different stages have various morphological characteristics. Therefore, bone age assessment (BAA) can accurately reflect the individual's growth and development level and maturity. Clinical BAA is time consuming, highly subjective, and lacks consistency. Deep learning has made considerable progress in BAA in recent years by effectively extracting deep features. Most studies use neural networks to extract global information from input images. However, clinical radiologists are highly concerned about the ossification degree in some specific regions of the hand bones. This paper proposes a two-stage convolutional transformer network to improve the accuracy of BAA. Combined with object detection and transformer, the first stage mimics the bone age reading process of the pediatrician, extracts the hand bone region of interest (ROI) in real time using YOLOv5, and proposes hand bone posture alignment. In addition, the previous information encoding of biological sex is integrated into the feature map to replace the position token in the transformer. The second stage extracts features within the ROI by window attention, interacts between different ROIs by shifting the window attention to extract hidden feature information, and penalizes the evaluation results using a hybrid loss function to ensure its stability and accuracy. The proposed method is evaluated on the data from the Pediatric Bone Age Challenge organized by the Radiological Society of North America (RSNA). The experimental results show that the proposed method achieves a mean absolute error (MAE) of 6.22 and 4.585 months on the validation and testing sets, respectively, and the cumulative accuracy within 6 and 12 months reach 71% and 96%, respectively, which is comparable to the state of the art, markedly reducing the clinical workload and realizing rapid, automatic, and high-precision assessment.

Hand bone extraction method research based on ASM

Bone age assessment based on deep neural networks with annotation-free cascaded critical bone region extraction.

X-ray Finger Bone Image Segmentation Method Based on OpenCV

Carpal-bone Feature Extraction Analysis in Skeletal Age Assessment Based on Deformable Model

Fully Automated Bone Age Assessment on Large-Scale Hand X-Ray Dataset

Residual Attention based Network for Hand Bone Age Assessment

X-ray Carpal-Bone Image Boundary Feature Analysis Using Region Statistical Feature Based Level Set Method for Skeletal Age Assessment Application

Research on an Automatic Bone Maturation Evaluation Method Based on CHN

A Multi-Scale Framework Based on Jigsaw Patches and Focused Label Smoothing for Bone Age Assessment.

Automated Bone Age Assessment: A New Three-Stage Assessment Method from Coarse to Fine

A Research of Bone Maturation Evaluation System Based on Active Shape Models

A Deep Automated Skeletal Bone Age Assessment Model Via Region-Based Convolutional Neural Network

Automated Skeletal Bone Age Assessment with Two-Stage Convolutional Transformer Network Based on X-ray Images

Improve bone age assessment by learning from anatomical local regions

Automatic Bone Age Assessment of Adolescents Based on Weakly-Supervised Deep Convolutional Neural Networks

Radiographs and Texts Fusion Learning Based Deep Networks for Skeletal Bone Age Assessment

A BONE AGE RECOGNITION METHOD BASED ON k-COSINE CURVATURE AND WSVM

A feature-enhanced multiscale attention approach for automated hand bone segmentation

Bone Age Estimation with X-ray Images Based on EfficientNet Pre-training Model

Adaptive Critical Region Extraction Net Via Relationship Modeling for Bone Age Assessment

Bone age recognition based on mask R-CNN using xception regression model