Abstract:Abstract Background Chest X-rays are the most commonly available and affordable radiological examination for screening thoracic diseases. According to the domain knowledge of screening chest X-rays, the pathological information usually lay on the lung and heart regions. However, it is costly to acquire region-level annotation in practice, and model training mainly relies on image-level class labels in a weakly supervised manner, which is highly challenging for computer-aided chest X-ray screening. To address this issue, some methods have been proposed recently to identify local regions containing pathological information, which is vital for thoracic disease classification. Inspired by this, we propose a novel deep learning framework to explore discriminative information from lung and heart regions. Result We design a feature extractor equipped with a multi-scale attention module to learn global attention maps from global images. To exploit disease-specific cues effectively, we locate lung and heart regions containing pathological information by a well-trained pixel-wise segmentation model to generate binarization masks. By introducing element-wise logical AND operator on the learned global attention maps and the binarization masks, we obtain local attention maps in which pixels are are 1 for lung and heart region and 0 for other regions. By zeroing features of non-lung and heart regions in attention maps, we can effectively exploit their disease-specific cues in lung and heart regions. Compared to existing methods fusing global and local features, we adopt feature weighting to avoid weakening visual cues unique to lung and heart regions. Our method with pixel-wise segmentation can help overcome the deviation of locating local regions. Evaluated by the benchmark split on the publicly available chest X-ray14 dataset, the comprehensive experiments show that our method achieves superior performance compared to the state-of-the-art methods. Conclusion We propose a novel deep framework for the multi-label classification of thoracic diseases in chest X-ray images. The proposed network aims to effectively exploit pathological regions containing the main cues for chest X-ray screening. Our proposed network has been used in clinic screening to assist the radiologists. Chest X-ray accounts for a significant proportion of radiological examinations. It is valuable to explore more methods for improving performance.

Two-stream Collaborative Network for Multi-Label Chest X-ray Image Classification with Lung Segmentation

Weighing features of lung and heart regions for thoracic disease classification

Multi-label local awareness and global co-occurrence priori learning improve chest X-ray classification

Multi-disease X-ray Image Classification of the Chest Based on Global and Local Fusion Adaptive Networks

Multi-Label Chest X-Ray Image Classification via Semantic Similarity Graph Embedding

DualAttNet: Synergistic Fusion of Image-level and Fine-Grained Disease Attention for Multi-Label Lesion Detection in Chest X-rays

Modeling Global and Local Label Correlation with Graph Convolutional Networks for Multi-Label Chest X-ray Image Classification

A Multi-Objective Segmentation Method for Chest X-rays Based on Collaborative Learning from Multiple Partially Annotated Datasets

BB-GCN: A Bi-modal Bridged Graph Convolutional Network for Multi-label Chest X-Ray Recognition

[Non-local attention and multi-task learning based lung segmentation in chest X-ray]

Deep Learning Based Classification of Multi-Label Chest X-ray Images Via Dual-Weighted Metric Loss

Learning group-wise spatial attention and label dependencies for multi-task thoracic disease classification

GCN-RNN: an Unified Framework for Modeling the Multi-Label Diagnosis of Chest X-ray Disease

H-SegNet: hybrid segmentation network for lung segmentation in chest radiographs using mask region-based convolutional neural network and adaptive closed polyline searching method

Multi-attention Network for Thoracic Disease Classification and Localization

Label Semantic Improvement with Graph Convolutional Networks for Multi-Label Chest X-Ray Image Classification

Improving Classification Model Performance on Chest X-Rays through Lung Segmentation

MS-ANet: Deep Learning for Automated Multi-Label Thoracic Disease Detection and Classification.

CorLabelNet: a Comprehensive Framework for Multi-Label Chest X-ray Image Classification with Correlation Guided Discriminant Feature Learning and Oversampling

Multi-Label Local to Global Learning: A Novel Learning Paradigm for Chest X-Ray Abnormality Classification.

Multi-scale Lesion Feature Fusion and Location-Aware for Chest Multi-disease Detection