Abstract:Abstract Background Chest X-rays are the most commonly available and affordable radiological examination for screening thoracic diseases. According to the domain knowledge of screening chest X-rays, the pathological information usually lay on the lung and heart regions. However, it is costly to acquire region-level annotation in practice, and model training mainly relies on image-level class labels in a weakly supervised manner, which is highly challenging for computer-aided chest X-ray screening. To address this issue, some methods have been proposed recently to identify local regions containing pathological information, which is vital for thoracic disease classification. Inspired by this, we propose a novel deep learning framework to explore discriminative information from lung and heart regions. Result We design a feature extractor equipped with a multi-scale attention module to learn global attention maps from global images. To exploit disease-specific cues effectively, we locate lung and heart regions containing pathological information by a well-trained pixel-wise segmentation model to generate binarization masks. By introducing element-wise logical AND operator on the learned global attention maps and the binarization masks, we obtain local attention maps in which pixels are are 1 for lung and heart region and 0 for other regions. By zeroing features of non-lung and heart regions in attention maps, we can effectively exploit their disease-specific cues in lung and heart regions. Compared to existing methods fusing global and local features, we adopt feature weighting to avoid weakening visual cues unique to lung and heart regions. Our method with pixel-wise segmentation can help overcome the deviation of locating local regions. Evaluated by the benchmark split on the publicly available chest X-ray14 dataset, the comprehensive experiments show that our method achieves superior performance compared to the state-of-the-art methods. Conclusion We propose a novel deep framework for the multi-label classification of thoracic diseases in chest X-ray images. The proposed network aims to effectively exploit pathological regions containing the main cues for chest X-ray screening. Our proposed network has been used in clinic screening to assist the radiologists. Chest X-ray accounts for a significant proportion of radiological examinations. It is valuable to explore more methods for improving performance.

Multi-label local awareness and global co-occurrence priori learning improve chest X-ray classification

Multi-Label Local to Global Learning: A Novel Learning Paradigm for Chest X-Ray Abnormality Classification.

Modeling Global and Local Label Correlation with Graph Convolutional Networks for Multi-Label Chest X-ray Image Classification

Learning group-wise spatial attention and label dependencies for multi-task thoracic disease classification

MRChexNet: Multi-modal bridge and relational learning for thoracic disease recognition in chest X-rays

BB-GCN: A Bi-modal Bridged Graph Convolutional Network for Multi-label Chest X-Ray Recognition

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Multi-label Chest X-ray Image Classification Via Category-Wise Residual Attention Learning

Label correlation guided discriminative label feature learning for multi-label chest image classification

Label Semantic Improvement with Graph Convolutional Networks for Multi-Label Chest X-Ray Image Classification

MS-ANet: Deep Learning for Automated Multi-Label Thoracic Disease Detection and Classification.

Weighing features of lung and heart regions for thoracic disease classification

Deep Hiearchical Multi-Label Classification Applied to Chest X-Ray Abnormality Taxonomies

CorLabelNet: a Comprehensive Framework for Multi-Label Chest X-ray Image Classification with Correlation Guided Discriminant Feature Learning and Oversampling

Multi-Label Chest X-Ray Image Classification via Semantic Similarity Graph Embedding

Multi-disease X-ray Image Classification of the Chest Based on Global and Local Fusion Adaptive Networks

Expert Uncertainty and Severity Aware Chest X-Ray Classification by Multi-Relationship Graph Learning

GCN-RNN: an Unified Framework for Modeling the Multi-Label Diagnosis of Chest X-ray Disease

Multi-Label Learning With Visual-Semantic Embedded Knowledge Graph for Diagnosis of Radiology Imaging

Multi-label neural architecture search for chest radiography image classification

Attention-Guided Curriculum Learning for Weakly Supervised Classification and Localization of Thoracic Diseases on Chest Radiographs