Abstract:Abstract The detailed physiological perspectives captured by medical imaging provides actionable insights to doctors to manage comprehensive care of patients. However, the quality of such diagnostic image modalities is often affected by mismanagement of the image capturing process by poorly trained technicians and older/poorly maintained imaging equipment. Further, a patient is often subjected to scanning at different orientations to capture the frontal, lateral and sagittal views of the affected areas. Due to the large volume of diagnostic scans performed at a modern hospital, adequate documentation of such additional perspectives is mostly overlooked, which is also an essential key element of quality diagnostic systems and predictive analytics systems. Another crucial challenge affecting effective medical image data management is that the diagnostic scans are essentially stored as unstructured data, lacking a well-defined processing methodology for enabling intelligent image data management for supporting applications like similar patient retrieval , automated disease prediction etc. One solution is to incorporate automated diagnostic image descriptions of the observation/findings by leveraging computer vision and natural language processing. In this work, we present multi-task neural models capable of addressing these critical challenges. We propose ESRGAN, an image enhancement technique for improving the quality and visualization of medical chest x-ray images, thereby substantially improving the potential for accurate diagnosis, automatic detection and region-of-interest segmentation. We also propose a CNN-based model called ViewNet for predicting the view orientation of the x-ray image and generating a medical report using Xception net, thus facilitating a robust medical image management system for intelligent diagnosis applications. Experimental results are demonstrated using standard metrics like BRISQUE, PIQE and BLEU scores, indicating that the proposed models achieved excellent performance. Further, the proposed deep learning approaches enable diagnosis in a lesser time and their hybrid architecture shows significant potential for supporting many intelligent diagnosis applications.

Deep Learning for Report Generation on Chest X-ray Images

Deep learning for chest X-ray analysis: A survey

Automated Radiological Report Generation For Chest X-Rays With Weakly-Supervised End-to-End Deep Learning

A survey on automatic generation of medical imaging reports based on deep learning

Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

Automatic Generation of Chest X-ray Reports Using a Transformer-based Deep Learning Model

A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data

Chest X-ray Images for Lung Disease Detection Using Deep Learning Techniques: A Comprehensive Survey

Learning to Read Chest X-Ray Images from 16000+ Examples Using CNN

Automated Chest X-Ray Report Generator Using Multi-Model Deep Learning Approach

Attention based automated radiology report generation using CNN and LSTM

A Systematic Review of Deep Learning-based Research on Radiology Report Generation

Automated Radiological Impression Generation For Plain Chest X-Rays With End To End Deep Learning

Chest X-ray Report Generation through Fine-Grained Label Learning

Can Artificial Intelligence Reliably Report Chest X-Rays?: Radiologist Validation of an Algorithm trained on 2.3 Million X-Rays

Deep Learning Approaches for Chest Radiograph Interpretation: A Systematic Review

Comparative effectiveness of convolutional neural network (CNN) and recurrent neural network (RNN) architectures for radiology text report classification

RadTex: Learning Efficient Radiograph Representations from Text Reports

Deep Learning Approaches for Detecting COVID-19 From Chest X-Ray Images: A Survey

Supervised and unsupervised language modelling in Chest X-Ray radiological reports

Applying Deep Learning for Breast Cancer Detection in Radiology