Abstract:Background: Bone age assessment (BAA) is crucial for the diagnosis of growth disorders and the optimization of treatments. However, the random error caused by different observers' experiences and the low consistency of repeated assessments harms the quality of such assessments. Thus, automated assessment methods are needed. Methods: Previous research has sought to design localization modules in a strongly or weakly supervised fashion to aggregate part regions to better recognize subtle differences. Conversely, we sought to efficiently deliver information between multi-granularity regions for fine-grained feature learning and to directly model long-distance relationships for global understanding. The proposed method has been named the "Multi-Granularity and Multi-Attention Net (2M-Net)". Specifically, we first applied the jigsaw method to generate related tasks emphasizing regions with different granularities, and we then trained the model on these tasks using a hierarchical sharing mechanism. In effect, the training signals from the extra tasks created as an inductive bias, enabling 2M-Net to discover task relatedness without the need for annotations. Next, the self-attention mechanism acted as a plug-and-play module to effectively enhance the feature representation capabilities. Finally, multi-scale features were applied for prediction. Results: A public data set of 14,236 hand radiographs, provided by the Radiological Society of North America (RSNA), was used to develop and validate 2M-Net. In the public benchmark testing, the mean absolute error (MAE) between the bone age estimates of the model and of the reviewer was 3.98 months (3.89 months for males and 4.07 months for females). Conclusions: By using the jigsaw method to construct a multi-task learning strategy and inserting the self-attention module for efficient global modeling, we established 2M-Net, which is comparable to the previous best method in terms of performance.

Multi-view Adaptive Bone Activation from Chest X-Ray with Conditional Adversarial Nets

High-Resolution Chest X-Ray Bone Suppression Using Unpaired CT Structural Priors

Learning Bone Suppression from Dual Energy Chest X-rays using Adversarial Networks

BS-Diff: Effective Bone Suppression Using Conditional Diffusion Models from Chest X-Ray Images

Bone age assessment based on deep neural networks with annotation-free cascaded critical bone region extraction.

A Skeleton-based Action Recognition System for Medical Condition Detection

Generation of Virtual Dual Energy Images from Standard Single-Shot Radiographs using Multi-scale and Conditional Adversarial Network

Encoding CT Anatomy Knowledge for Unpaired Chest X-ray Image Decomposition

Automated Skeletal Bone Age Assessment with Two-Stage Convolutional Transformer Network Based on X-ray Images

A Multi-Scale Data Fusion Framework for Bone Age Assessment with Convolutional Neural Networks.

A Deep Automated Skeletal Bone Age Assessment Model Via Region-Based Convolutional Neural Network

DeBoNet: A deep bone suppression model ensemble to improve disease detection in chest radiographs

Bone Structures Extraction and Enhancement in Chest Radiographs via CNN Trained on Synthetic Data

Multi-Task Convolutional Neural Network for Joint Bone Age Assessment and Ossification Center Detection from Hand Radiograph.

Multi-structure bone segmentation in pediatric MR images with combined regularization from shape priors and adversarial network

MSADCN: Multi-Scale Attentional Densely Connected Network for Automated Bone Age Assessment

Lumbar Bone Mineral Density Estimation From Chest X-Ray Images: Anatomy-Aware Attentive Multi-ROI Modeling

Residual Attention based Network for Hand Bone Age Assessment

Attention-based multiple-instance learning for Pediatric bone age assessment with efficient and interpretable

Enhanced deep residual network for bone classification and abnormality detection

Bone age assessment by multi-granularity and multi-attention feature encoding