Abstract:Abstract The detailed physiological perspectives captured by medical imaging provides actionable insights to doctors to manage comprehensive care of patients. However, the quality of such diagnostic image modalities is often affected by mismanagement of the image capturing process by poorly trained technicians and older/poorly maintained imaging equipment. Further, a patient is often subjected to scanning at different orientations to capture the frontal, lateral and sagittal views of the affected areas. Due to the large volume of diagnostic scans performed at a modern hospital, adequate documentation of such additional perspectives is mostly overlooked, which is also an essential key element of quality diagnostic systems and predictive analytics systems. Another crucial challenge affecting effective medical image data management is that the diagnostic scans are essentially stored as unstructured data, lacking a well-defined processing methodology for enabling intelligent image data management for supporting applications like similar patient retrieval , automated disease prediction etc. One solution is to incorporate automated diagnostic image descriptions of the observation/findings by leveraging computer vision and natural language processing. In this work, we present multi-task neural models capable of addressing these critical challenges. We propose ESRGAN, an image enhancement technique for improving the quality and visualization of medical chest x-ray images, thereby substantially improving the potential for accurate diagnosis, automatic detection and region-of-interest segmentation. We also propose a CNN-based model called ViewNet for predicting the view orientation of the x-ray image and generating a medical report using Xception net, thus facilitating a robust medical image management system for intelligent diagnosis applications. Experimental results are demonstrated using standard metrics like BRISQUE, PIQE and BLEU scores, indicating that the proposed models achieved excellent performance. Further, the proposed deep learning approaches enable diagnosis in a lesser time and their hybrid architecture shows significant potential for supporting many intelligent diagnosis applications.

Convolutional Redistribution Network for Multi-view Medical Image Diagnosis.

Domain Invariant Model with Graph Convolutional Network for Mammogram Classification

Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

Multi-Disease Diagnosis Using Medical Images

Mutual Attention-based Hybrid Dimensional Network for Multimodal Imaging Computer-aided Diagnosis

Multi-DeepNet: A Novel Weakly-Supervised Multi-Task and Multi-View-Oriented Convolution Neural Network for COVID-19 Diagnosis from CT Images

Multi-task Dictionary Learning based Convolutional Neural Network for Computer aided Diagnosis with Longitudinal Images

Multi-Task Medical Concept Normalization Using Multi-View Convolutional Neural Network

Cross-modality Guidance-aided Multi-modal Learning with Dual Attention for MRI Brain Tumor Grading

A Deep Information Sharing Network for Multi-contrast Compressed Sensing MRI Reconstruction

Gradient modulated contrastive distillation of low-rank multi-modal knowledge for disease diagnosis

Multi-View Mammographic Density Classification by Dilated and Attention-Guided Residual Learning.

Classification of Breast Mass in 3D Ultrasound Images with Annotations Based on Convolutional Neural Networks

New convolutional neural network model for screening and diagnosis of mammograms

MVCINN: Multi-View Diabetic Retinopathy Detection Using a Deep Cross-Interaction Neural Network

Two-view Attention-Guided Convolutional Neural Network for Mammographic Image Classification.

Using Multi-Task Learning to Improve Diagnostic Performance of Convolutional Neural Networks

Multi-view convolutional neural network with leader and long-tail particle swarm optimizer for enhancing heart disease and breast cancer detection

An Attentive Multi-Modal CNN for Brain Tumor Radiogenomic Classification

A deep neural network model for content-based medical image retrieval with multi-view classification

Application Exploration of Medical Image-aided Diagnosis of Breast Tumour Based on Deep Learning