Abstract:Abstract The detailed physiological perspectives captured by medical imaging provides actionable insights to doctors to manage comprehensive care of patients. However, the quality of such diagnostic image modalities is often affected by mismanagement of the image capturing process by poorly trained technicians and older/poorly maintained imaging equipment. Further, a patient is often subjected to scanning at different orientations to capture the frontal, lateral and sagittal views of the affected areas. Due to the large volume of diagnostic scans performed at a modern hospital, adequate documentation of such additional perspectives is mostly overlooked, which is also an essential key element of quality diagnostic systems and predictive analytics systems. Another crucial challenge affecting effective medical image data management is that the diagnostic scans are essentially stored as unstructured data, lacking a well-defined processing methodology for enabling intelligent image data management for supporting applications like similar patient retrieval , automated disease prediction etc. One solution is to incorporate automated diagnostic image descriptions of the observation/findings by leveraging computer vision and natural language processing. In this work, we present multi-task neural models capable of addressing these critical challenges. We propose ESRGAN, an image enhancement technique for improving the quality and visualization of medical chest x-ray images, thereby substantially improving the potential for accurate diagnosis, automatic detection and region-of-interest segmentation. We also propose a CNN-based model called ViewNet for predicting the view orientation of the x-ray image and generating a medical report using Xception net, thus facilitating a robust medical image management system for intelligent diagnosis applications. Experimental results are demonstrated using standard metrics like BRISQUE, PIQE and BLEU scores, indicating that the proposed models achieved excellent performance. Further, the proposed deep learning approaches enable diagnosis in a lesser time and their hybrid architecture shows significant potential for supporting many intelligent diagnosis applications.

A Principled Approach to Failure Analysis and Model Repairment: Demonstration in Medical Imaging

Unifying Defect Prediction, Categorization, and Repair by Multi-Task Deep Learning

Repairing Neural Networks by Leaving the Right Past Behind

Practical Insights of Repairing Model Problems on Image Classification

What could go wrong? Discovering and describing failure modes in computer vision

Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

Fast Automated Abstract Machine Repair Using Simultaneous Modifications and Refactoring.

A Call to Reflect on Evaluation Practices for Failure Detection in Image Classification

Failures Are Fated, But Can Be Faded: Characterizing and Mitigating Unwanted Behaviors in Large-Scale Vision and Language Models

An Effective Data-Driven Approach for Localizing Deep Learning Faults

A Bayesian approach to breaking things: efficiently predicting and repairing failure modes via sampling

Evaluating Generalization, Bias, and Fairness in Deep Learning for Metal Surface Defect Detection: A Comparative Study

Understanding Silent Failures in Medical Image Classification

Beyond rankings: Learning (more) from algorithm validation

Automated Detection of hidden Damages and Impurities in Aluminum Die Casting Materials and Fibre-Metal Laminates using Low-quality X-ray Radiography, Synthetic X-ray Data Augmentation by Simulation, and Machine Learning

Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs

Quantitative assessment of machine learning reliability and resilience

PRIME: Prioritizing Interpretability in Failure Mode Extraction

Validating Unsupervised Machine Learning Techniques for Software Defect Prediction With Generic Metamorphic Testing

LLM-Assisted Red Teaming of Diffusion Models through "Failures Are Fated, But Can Be Faded"

How can we learn (more) from challenges? A statistical approach to driving future algorithm development