Abstract:Abstract The detailed physiological perspectives captured by medical imaging provides actionable insights to doctors to manage comprehensive care of patients. However, the quality of such diagnostic image modalities is often affected by mismanagement of the image capturing process by poorly trained technicians and older/poorly maintained imaging equipment. Further, a patient is often subjected to scanning at different orientations to capture the frontal, lateral and sagittal views of the affected areas. Due to the large volume of diagnostic scans performed at a modern hospital, adequate documentation of such additional perspectives is mostly overlooked, which is also an essential key element of quality diagnostic systems and predictive analytics systems. Another crucial challenge affecting effective medical image data management is that the diagnostic scans are essentially stored as unstructured data, lacking a well-defined processing methodology for enabling intelligent image data management for supporting applications like similar patient retrieval , automated disease prediction etc. One solution is to incorporate automated diagnostic image descriptions of the observation/findings by leveraging computer vision and natural language processing. In this work, we present multi-task neural models capable of addressing these critical challenges. We propose ESRGAN, an image enhancement technique for improving the quality and visualization of medical chest x-ray images, thereby substantially improving the potential for accurate diagnosis, automatic detection and region-of-interest segmentation. We also propose a CNN-based model called ViewNet for predicting the view orientation of the x-ray image and generating a medical report using Xception net, thus facilitating a robust medical image management system for intelligent diagnosis applications. Experimental results are demonstrated using standard metrics like BRISQUE, PIQE and BLEU scores, indicating that the proposed models achieved excellent performance. Further, the proposed deep learning approaches enable diagnosis in a lesser time and their hybrid architecture shows significant potential for supporting many intelligent diagnosis applications.

Automating Abnormality Detection in Musculoskeletal Radiographs through Deep Learning

Hybrid Deep Learning Approach for Automatic Detection in Musculoskeletal Radiographs

Deep Learning for Musculoskeletal Image Analysis

Automatic Knee Osteoarthritis Diagnosis from Plain Radiographs: A Deep Learning-Based Approach

Abnormality Detection in Mammography using Deep Convolutional Neural Networks

Detecting mechanical loosening of total hip replacement implant from plain radiograph using deep convolutional neural network

Improved Automated Quality Control of Skeletal Wrist Radiographs Using Deep Multitask Learning

Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

X-Ray bone abnormalities detection using MURA dataset

Designing an Intelligent Lesion Detection System Using Deep Architecture Neural Networks in the Lower Limb X-Ray Images

Cross-Center Validation of Deep Learning Model for Musculoskeletal Fracture Detection in Radiographic Imaging: A Feasibility Study

Give me a knee radiograph, I will tell you where the knee joint area is: a deep convolutional neural network adventure

Deep Learning for Lesion Detection, Progression, and Prediction of Musculoskeletal Disease

DeepRA: Predicting Joint Damage From Radiographs Using CNN with Attention

Automated patellar height assessment on high-resolution radiographs with a novel deep learning-based approach

Enhanced deep residual network for bone classification and abnormality detection

Radiomics and Deep Learning for Disease Detection in Musculoskeletal Radiology: An Overview of Novel MRI- and CT-Based Approaches

Deep learning-based algorithm for assessment of knee osteoarthritis severity in radiographs matches performance of radiologists

Deep learning segmentation of transverse musculoskeletal ultrasound images for neuromuscular disease assessment

Can Artificial Intelligence Reliably Report Chest X-Rays?: Radiologist Validation of an Algorithm trained on 2.3 Million X-Rays

MedKnee: A New Deep Learning-Based Software for Automated Prediction of Radiographic Knee Osteoarthritis