Abstract:Background: Bone age assessment (BAA) is crucial for the diagnosis of growth disorders and the optimization of treatments. However, the random error caused by different observers' experiences and the low consistency of repeated assessments harms the quality of such assessments. Thus, automated assessment methods are needed. Methods: Previous research has sought to design localization modules in a strongly or weakly supervised fashion to aggregate part regions to better recognize subtle differences. Conversely, we sought to efficiently deliver information between multi-granularity regions for fine-grained feature learning and to directly model long-distance relationships for global understanding. The proposed method has been named the "Multi-Granularity and Multi-Attention Net (2M-Net)". Specifically, we first applied the jigsaw method to generate related tasks emphasizing regions with different granularities, and we then trained the model on these tasks using a hierarchical sharing mechanism. In effect, the training signals from the extra tasks created as an inductive bias, enabling 2M-Net to discover task relatedness without the need for annotations. Next, the self-attention mechanism acted as a plug-and-play module to effectively enhance the feature representation capabilities. Finally, multi-scale features were applied for prediction. Results: A public data set of 14,236 hand radiographs, provided by the Radiological Society of North America (RSNA), was used to develop and validate 2M-Net. In the public benchmark testing, the mean absolute error (MAE) between the bone age estimates of the model and of the reviewer was 3.98 months (3.89 months for males and 4.07 months for females). Conclusions: By using the jigsaw method to construct a multi-task learning strategy and inserting the self-attention module for efficient global modeling, we established 2M-Net, which is comparable to the previous best method in terms of performance.

A feature-enhanced multiscale attention approach for automated hand bone segmentation

Residual Attention based Network for Hand Bone Age Assessment

Pairwise attention-enhanced adversarial model for automatic bone segmentation in CT images

A Lightweight U-Net Architecture Multi-Scale Convolutional Network for Pediatric Hand Bone Segmentation in X-Ray Image.

Bone age assessment based on deep neural networks with annotation-free cascaded critical bone region extraction.

ARAA-Net: Adaptive Region-Aware Attention Network for Epiphysis and Articular Surface Segmentation from Hand Radiographs

Towards Cross-Scale Attention and Surface Supervision for Fractured Bone Segmentation in CT

MSADCN: Multi-Scale Attentional Densely Connected Network for Automated Bone Age Assessment

Craniomaxillofacial Bone Segmentation and Landmark Detection Using Semantic Segmentation Networks and an Unbiased Heatmap.

Fully Automated Bone Age Assessment on Large-Scale Hand X-Ray Dataset

A deep multi-filtering network based on dilated mask RCNN framework with self-attention RNN model for segmenting and classifying bone fracture

Bone age assessment by multi-granularity and multi-attention feature encoding

SegmentAnyBone: A Universal Model that Segments Any Bone at Any Location on MRI

Enhanced Attention Res-Unet for Segmentation of Knee Bones

Automatic multi-structure pediatric knee bone segmentation using optimal multi-level Otsu thresholding to tackle intensity homogeneity in bone structures

Expeditious detection and segmentation of bone mass variation in DEXA images using the hybrid GLCM-AlexNet approach

An Intelligent Auxiliary Framework for Bone Malignant Tumor Lesion Segmentation in Medical Image Analysis

2D-3D Hierarchical Feature Fusion Network for Segmentation of Bone Structure in Knee Mr Image

Multi-structure bone segmentation in pediatric MR images with combined regularization from shape priors and adversarial network

Exploring Weakly Supervised Semantic Segmentation Ensembles for Medical Imaging Systems

Multimodal Data-Driven Segmentation of Bone Metastasis Lesions in SPECT Bone Scans Using Deep Learning