Abstract:Abstract The detailed physiological perspectives captured by medical imaging provides actionable insights to doctors to manage comprehensive care of patients. However, the quality of such diagnostic image modalities is often affected by mismanagement of the image capturing process by poorly trained technicians and older/poorly maintained imaging equipment. Further, a patient is often subjected to scanning at different orientations to capture the frontal, lateral and sagittal views of the affected areas. Due to the large volume of diagnostic scans performed at a modern hospital, adequate documentation of such additional perspectives is mostly overlooked, which is also an essential key element of quality diagnostic systems and predictive analytics systems. Another crucial challenge affecting effective medical image data management is that the diagnostic scans are essentially stored as unstructured data, lacking a well-defined processing methodology for enabling intelligent image data management for supporting applications like similar patient retrieval , automated disease prediction etc. One solution is to incorporate automated diagnostic image descriptions of the observation/findings by leveraging computer vision and natural language processing. In this work, we present multi-task neural models capable of addressing these critical challenges. We propose ESRGAN, an image enhancement technique for improving the quality and visualization of medical chest x-ray images, thereby substantially improving the potential for accurate diagnosis, automatic detection and region-of-interest segmentation. We also propose a CNN-based model called ViewNet for predicting the view orientation of the x-ray image and generating a medical report using Xception net, thus facilitating a robust medical image management system for intelligent diagnosis applications. Experimental results are demonstrated using standard metrics like BRISQUE, PIQE and BLEU scores, indicating that the proposed models achieved excellent performance. Further, the proposed deep learning approaches enable diagnosis in a lesser time and their hybrid architecture shows significant potential for supporting many intelligent diagnosis applications.

Weakly Guided Hierarchical Encoder-Decoder Network for Brain CT Report Generation.

Automatic Report Generation Method Based on Multiscale Feature Extraction and Word Attention Network.

Weakly Guided Attention Model with Hierarchical Interaction for Brain CT Report Generation.

VMEKNet: Visual Memory and External Knowledge Based Network for Medical Report Generation.

Co-Occurrence Relationship Driven Hierarchical Attention Network for Brain CT Report Generation

A medical report generation method integrating teacher–student model and encoder–decoder network

Intensive Vision-guided Network for Radiology Report Generation

See Detail Say Clear: Towards Brain CT Report Generation via Pathological Clue-driven Representation Learning

Granularity Matters: Pathological Graph-driven Cross-modal Alignment for Brain CT Report Generation

Work like a doctor: Unifying scan localizer and dynamic generator for automated computed tomography report generation

On the Automatic Generation of Medical Imaging Reports

Memory-based Cross-modal Semantic Alignment Network for Radiology Report Generation

Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

MATNet: Exploiting Multi-Modal Features for Radiology Report Generation.

Eye Gaze Guided Cross-Modal Alignment Network for Radiology Report Generation.

Prior tissue knowledge-driven contrastive learning for brain CT report generation

Automatic segmentation of intracerebral hemorrhage in CT images using encoder–decoder convolutional neural network

GHCL: Gaussian heuristic curriculum learning for Brain CT report generation

Generating radiology reports via auxiliary signal guidance and a memory-driven network

Visual-Textual Cross-Modal Interaction Network for Radiology Report Generation

Large Language Model with Region-guided Referring and Grounding for CT Report Generation