Abstract:The interpretation of medical images is a complex cognition procedure requiring cautious observation, precise understanding/parsing of the normal body anatomies, and combining knowledge of physiology and pathology. Interpreting chest X-ray (CXR) images is challenging since the 2D CXR images show the superimposition on internal organs/tissues with low resolution and poor boundaries. Unlike previous CXR computer-aided diagnosis works that focused on disease diagnosis/classification, we firstly propose a deep disentangled generative model (DGM) simultaneously generating abnormal disease residue maps and "radiorealistic" normal CXR images from an input abnormal CXR image. The intuition of our method is based on the assumption that disease regions usually superimpose upon or replace the pixels of normal tissues in an abnormal CXR. Thus, disease regions can be disentangled or decomposed from the abnormal CXR by comparing it with a generated patient-specific normal CXR. DGM consists of three encoder-decoder architecture branches: one for radiorealistic normal CXR image synthesis using adversarial learning, one for disease separation by generating a residue map to delineate the underlying abnormal region, and the other one for facilitating the training process and enhancing the model's robustness on noisy data. A self-reconstruction loss is adopted in the first two branches to enforce the generated normal CXR image to preserve similar visual structures as the original CXR. We evaluated our model on a large-scale chest X-ray dataset. The results show that our model can generate disease residue/saliency maps (coherent with radiologist annotations) along with radiorealistic and patient specific normal CXR images. The disease residue/saliency map can be used by radiologists to improve the CXR reading efficiency in clinical practice. The synthesized normal CXR can be used for data augmentation and normal control of personalized longitudinal disease study. Furthermore, DGM quantitatively boosts the diagnosis performance on several important clinical applications, including normal/abnormal CXR classification, and lung opacity classification/detection.

Learning Group-Disentangled Representation for Interpretable Thoracic Pathologic Prediction.

Interpretable thoracic pathologic prediction via learning group-disentangled representation

GDRL: An Interpretable Framework for Thoracic Pathologic Prediction

Disentangling Disease-related Representation from Obscure for Disease Prediction.

Translational Lung Imaging Analysis Through Disentangled Representations

Learning To Recognize Thoracic Disease In Chest X-Rays With Knowledge-Guided Deep Zoom Neural Networks

A Disentangled Generative Model for Disease Decomposition in Chest X-rays Via Normal Image Synthesis.

Learning group-wise spatial attention and label dependencies for multi-task thoracic disease classification

Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for Thoracic Disease Identification

Discriminative Feature Learning for Thorax Disease Classification in Chest X-ray Images

Weakly Supervised Deep Learning for Thoracic Disease Classification and Localization on Chest X-rays

GAN-based disentanglement learning for chest X-ray rib suppression

Learning Low-Rank Feature for Thorax Disease Classification

Label Generation Network based on Self-selected Historical Information for Multiple Disease Classification on Chest Radiography.

Detecting Thoracic Diseases Via Representation Learning with Adaptive Sampling

Thoracic Disease Identification and Localization using Distance Learning and Region Verification

Triple Attention Learning for Classification of 14 Thoracic Diseases Using Chest Radiography.

Learning by Reasoning: an Explainable Hierarchical Association Regularized Deep Learning Method for Disease Prediction.

Dynamic Routing on Deep Neural Network for Thoracic Disease Classification and Sensitive Area Localization

Automated Identification of Thoracic Pathology from Chest Radiographs with Enhanced Training Pipeline

Kgznet:Knowledge-Guided Deep Zoom Neural Networks For Thoracic Disease Classification