Abstract:Abstract The detailed physiological perspectives captured by medical imaging provides actionable insights to doctors to manage comprehensive care of patients. However, the quality of such diagnostic image modalities is often affected by mismanagement of the image capturing process by poorly trained technicians and older/poorly maintained imaging equipment. Further, a patient is often subjected to scanning at different orientations to capture the frontal, lateral and sagittal views of the affected areas. Due to the large volume of diagnostic scans performed at a modern hospital, adequate documentation of such additional perspectives is mostly overlooked, which is also an essential key element of quality diagnostic systems and predictive analytics systems. Another crucial challenge affecting effective medical image data management is that the diagnostic scans are essentially stored as unstructured data, lacking a well-defined processing methodology for enabling intelligent image data management for supporting applications like similar patient retrieval , automated disease prediction etc. One solution is to incorporate automated diagnostic image descriptions of the observation/findings by leveraging computer vision and natural language processing. In this work, we present multi-task neural models capable of addressing these critical challenges. We propose ESRGAN, an image enhancement technique for improving the quality and visualization of medical chest x-ray images, thereby substantially improving the potential for accurate diagnosis, automatic detection and region-of-interest segmentation. We also propose a CNN-based model called ViewNet for predicting the view orientation of the x-ray image and generating a medical report using Xception net, thus facilitating a robust medical image management system for intelligent diagnosis applications. Experimental results are demonstrated using standard metrics like BRISQUE, PIQE and BLEU scores, indicating that the proposed models achieved excellent performance. Further, the proposed deep learning approaches enable diagnosis in a lesser time and their hybrid architecture shows significant potential for supporting many intelligent diagnosis applications.

Interpreting Medical Image Classifiers by Optimization Based Counterfactual Impact Analysis

Domain aware medical image classifier interpretation by counterfactual impact analysis

Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

Enhancing Interpretability in Medical Image Classification by Integrating Formal Concept Analysis with Convolutional Neural Networks

Justifying Diagnosis Decisions by Deep Neural Networks

A Test Statistic Estimation-based Approach for Establishing Self-interpretable CNN-based Binary Classifiers

Visual Interpretation of Convolutional Neural Network Predictions in Classifying Medical Image Modalities

Improving Interpretability of Deep Neural Networks in Medical Diagnosis by Investigating the Individual Units

Auditing the inference processes of medical-image classifiers by leveraging generative AI and the expertise of physicians

Characterizing the Interpretability of Attention Maps in Digital Pathology

In-Depth Evaluation of Saliency Maps for Interpreting Convolutional Neural Network Decisions in the Diagnosis of Glaucoma Based on Fundus Imaging

Computerized Decision Support in Medical Imaging.

Performance Investigation for Medical Image Evaluation and Diagnosis Using Machine-Learning and Deep-Learning Techniques

Score-Based Counterfactual Generation for Interpretable Medical Image Classification and Lesion Localization.

Quantifying and leveraging predictive uncertainty for medical image assessment

Understanding Deep Neural Network Predictions for Medical Imaging Applications

Category-aware Feature Attribution for Self-Optimizing Medical Image Classification

Transparency of deep neural networks for medical image analysis: A review of interpretability methods

ACAT: Adversarial Counterfactual Attention for Classification and Detection in Medical Imaging

Influence of training and expertise on deep neural network attention and human attention during a medical image classification task