Abstract:Bones collaborate with muscles and joints to sustain and maintain our freedom of mobility. The proper musculoskeletal activity of bone protects and strengthens the brain, heart, and lung function. When a bone is subjected to a force greater than its structural capacity, it fractures. Bone fractures should be detected with the appropriate type and should be treated early to avoid acute neurovascular complications. The manual detection of bone fracture may lead to highly delayed complications like malunion, Joint stiffness, Contractures, Myositis ossificans, and Avascular necrosis. A proper classification system must be integrated with deep learning technology to classify bone fractures accurately. This motivates me to propose a Systematized Attention Gate UNet (SAG-UNet) that classifies the type of bone fracture with high accuracy. The main contribution of this research is two-fold. The first contribution focuses on dataset preprocessing through feature extraction using unsupervised learning by adapting the Growing Neural Gas (GNG) method. The second contribution deals with refining the supervised learning Attention UNet model that classifies the ten types of bone fracture. The attention gate of the Attention UNet model is refined and applied to the upsampling decoding layer of Attention UNet. The KAGGLE Bone Break Classification dataset was processed to extract only the essential features using GNG extraction. The quantized significant feature RGB X-ray image was divided into 900 training and 230 testing images in the ratio of 80:20. The training images are fitted with the existing CNN models like DenseNet, VGG, AlexNet, MobileNet, EfficientNet, Inception, Xception, UNet and Attention UNet to choose the best CNN model. Experiment results portray that Attention UNet offers the classification of bone fractures with an accuracy of 89% when testing bone break images. Now, the Attention UNet was chosen to refine the Attention gate of the Decoding upsampling layer that occurs after the encoding layer. The Attention Gate of the proposed SAG-UNet forms the gating coefficient from the input feature map and gate signal. The gating coefficient is then processed with batch normalization that centers the aligned features in the active region, thereby leaving the focus on the unaligned weights of feature maps. Then, the ReLU activation function is applied to introduce the nonlinearity in the aligned features, thereby learning the complex representation in the feature vector. Then, dropout is used to exclude the error noise in the aligned weights of the feature map. Then, 1 × 1 linear convolution transformation was done to form the vector concatenation-based attention feature map. This vector has been applied to the sigmoid activation to create the attention coefficient feature map with weights assigned as '1' for the aligned features. The attention coefficient feature map was grid resampled using trilinear interpolation to form the spatial attention weight map, which is passed to the skip connection of the next decoding layer. The implementation results reveal that the proposed SAG-UNet deep learning model classifies the bone fracture types with a high accuracy of 98.78% compared to the existing deep learning models.

A deep multi-filtering network based on dilated mask RCNN framework with self-attention RNN model for segmenting and classifying bone fracture

The Improved Faster-Rcnn for Spinal Fracture Lesions Detection.

An End-To-End Network For Detecting Multi-Domain Fractures On X-Ray Images

A real-time human bone fracture detection and classification from multi-modal images using deep learning technique

Hybrid SFNet Model for Bone Fracture Detection and Classification Using ML/DL

A novel approach towards the classification of Bone Fracture from Musculoskeletal Radiography images using Attention Based Transfer Learning

Detection of Spinal Fracture Lesions Based on Improved Faster-RCNN

The Dilated Dense U-net for Spinal Fracture Lesions Segmentation

Bone feature quantization and systematized attention gate UNet-based deep learning framework for bone fracture classification

Automatic fracture detection from the images of electrical image logs using Mask R-CNN

Deep Learning-Based Framework for Segmentation of Multiclass Rib Fractures in CT Utilizing a Multi-Angle Projection Network

Detection of whole body bone fractures based on improved YOLOv7

Artificial Intelligence-Based Brain Tumor Segmentation Using Adaptive Hybrid CNN and Classification by Multi-Scale Dilated MobileNet with Attention Mechanism for MRI Images

A feature-enhanced multiscale attention approach for automated hand bone segmentation

Enhancing fracture diagnosis in pelvic X-rays by deep convolutional neural network with synthesized images from 3D-CT

Simultaneous Segmentation and Classification of Bone Surfaces from Ultrasound Using a Multi-feature Guided CNN

Artificial Intelligence Model Trained with Sparse Data to Detect Facial and Cranial Bone Fractures from Head CT

Hybrid CNN-transformer Network for Interactive Learning of Challenging Musculoskeletal Images.

Multi-task Learning for Calcaneus Fracture Diagnosis of X-ray Images

Enhanced deep residual network for bone classification and abnormality detection

A Deep Learning Approach to Horse Bone Segmentation from Digitally Reconstructed Radiographs