Abstract:The interpretation of medical images is a complex cognition procedure requiring cautious observation, precise understanding/parsing of the normal body anatomies, and combining knowledge of physiology and pathology. Interpreting chest X-ray (CXR) images is challenging since the 2D CXR images show the superimposition on internal organs/tissues with low resolution and poor boundaries. Unlike previous CXR computer-aided diagnosis works that focused on disease diagnosis/classification, we firstly propose a deep disentangled generative model (DGM) simultaneously generating abnormal disease residue maps and "radiorealistic" normal CXR images from an input abnormal CXR image. The intuition of our method is based on the assumption that disease regions usually superimpose upon or replace the pixels of normal tissues in an abnormal CXR. Thus, disease regions can be disentangled or decomposed from the abnormal CXR by comparing it with a generated patient-specific normal CXR. DGM consists of three encoder-decoder architecture branches: one for radiorealistic normal CXR image synthesis using adversarial learning, one for disease separation by generating a residue map to delineate the underlying abnormal region, and the other one for facilitating the training process and enhancing the model's robustness on noisy data. A self-reconstruction loss is adopted in the first two branches to enforce the generated normal CXR image to preserve similar visual structures as the original CXR. We evaluated our model on a large-scale chest X-ray dataset. The results show that our model can generate disease residue/saliency maps (coherent with radiologist annotations) along with radiorealistic and patient specific normal CXR images. The disease residue/saliency map can be used by radiologists to improve the CXR reading efficiency in clinical practice. The synthesized normal CXR can be used for data augmentation and normal control of personalized longitudinal disease study. Furthermore, DGM quantitatively boosts the diagnosis performance on several important clinical applications, including normal/abnormal CXR classification, and lung opacity classification/detection.

GDRL: An Interpretable Framework for Thoracic Pathologic Prediction

Learning Group-Disentangled Representation for Interpretable Thoracic Pathologic Prediction.

Interpretable thoracic pathologic prediction via learning group-disentangled representation

Deep Reinforcement Learning Framework for Thoracic Diseases Classification via Prior Knowledge Guidance

Learning group-wise spatial attention and label dependencies for multi-task thoracic disease classification

Automated Identification of Thoracic Pathology from Chest Radiographs with Enhanced Training Pipeline

Learning To Recognize Thoracic Disease In Chest X-Rays With Knowledge-Guided Deep Zoom Neural Networks

MA10.02 Deep Learning with Radiomics May Predict High-Grade Lung Adenocarcinoma Based on Histological Patterns in Ground Glass Opacity Lesions

Weakly Supervised Deep Learning for Thoracic Disease Classification and Localization on Chest X-rays

Learning Low-Rank Feature for Thorax Disease Classification

A Disentangled Generative Model for Disease Decomposition in Chest X-rays Via Normal Image Synthesis.

Development and validation of an abnormality-derived deep-learning diagnostic system for major respiratory diseases

Dynamic Routing on Deep Neural Network for Thoracic Disease Classification and Sensitive Area Localization

Harnessing the Wisdom of a Radiologist: Texture-aware Curriculum Self-Supervised Learning for Thorax Disease Classification

Low-Shot Multi-label Incremental Learning for Thoracic Diseases Diagnosis

A Multi-Stage Framework for Joint Chest X-Ray Diagnosis and Visual Attention Prediction Using Deep Learning

Deep Mining External Imperfect Data for Chest X-Ray Disease Screening

An interpretable deep learning workflow for discovering subvisual abnormalities in CT scans of COVID-19 inpatients and survivors

AI-Driven Thoracic X-ray Diagnostics: Transformative Transfer Learning for Clinical Validation in Pulmonary Radiography

Kgznet:Knowledge-Guided Deep Zoom Neural Networks For Thoracic Disease Classification

Adversarial regression training for visualizing the progression of chronic obstructive pulmonary disease with chest x-rays