Abstract:Weakly supervised disease classification of CT imaging suffers from poor localization owing to case-level annotations, where even a positive scan can hold hundreds to thousands of negative slices along multiple planes. Furthermore, although deep learning segmentation and classification models extract distinctly unique combinations of anatomical features from the same target class(es), they are typically seen as two independent processes in a computer-aided diagnosis (CAD) pipeline, with little to no feature reuse. In this research, we propose a medical classifier that leverages the semantic structural concepts learned via multi-resolution segmentation feature maps, to guide weakly supervised 3D classification of chest CT volumes. Additionally, a comparative analysis is drawn across two different types of feature aggregation to explore the vast possibilities surrounding feature fusion. Using a dataset of 1593 scans labeled on a case-level basis via rule-based model, we train a dual-stage convolutional neural network (CNN) to perform organ segmentation and binary classification of four representative diseases (emphysema, pneumonia/atelectasis, mass and nodules) in lungs. The baseline model, with separate stages for segmentation and classification, results in AUC of 0.791. Using identical hyperparameters, the connected architecture using static and dynamic feature aggregation improves performance to AUC of 0.832 and 0.851, respectively. This study advances the field in two key ways. First, case-level report data is used to weakly supervise a 3D CT classifier of multiple, simultaneous diseases for an organ. Second, segmentation and classification models are connected with two different feature aggregation strategies to enhance the classification performance.

Robust Texture Features for Emphysema Classification in CT Images.

Classification and Quantification of Emphysema Using a Multi-Scale Residual Network

Joint Weber-Based Rotation Invariant Uniform Local Ternary Pattern for Classification of Pulmonary Emphysema in CT Images

Classification Of Pulmonary Emphysema In Ct Images Based On Multi-Scale Deep Convolutional Neural Networks

Multi-scale Residual Network with Two Channels of Raw CT Image and Its Differential Excitation Component for Emphysema Classification

Multi-scale Deep Convolutional Neural Networks for Emphysema Classification and Quantification

Robust deep labeling of radiological emphysema subtypes using squeeze and excitation convolutional neural networks: The MESA Lung and SPIROMICS Studies

A Feasibility Study of Extracting Tissue Textures from a Previous Full-Dose CT Database As Prior Knowledge for Bayesian Reconstruction of Current Low-Dose CT Images.

Semi-Supervised Learning for Semantic Segmentation of Emphysema With Partial Annotations

Automatic Emphysema Detection using Weakly Labeled HRCT Lung Images

COPD Classification in CT Images Using a 3D Convolutional Neural Network

Novel Subtypes of Pulmonary Emphysema Based on Spatially-Informed Lung Texture Learning

Robust Quantification of Percent Emphysema on CT via Domain Attention: the Multi-Ethnic Study of Atherosclerosis (MESA) Lung Study

Early Classification of Emphysema in CT Scans Using Deep Learning

Emphysema Subtyping on Thoracic Computed Tomography Scans using Deep Neural Networks

Computer-Aided Diagnosis system for diagnosis of pulmonary emphysema using bio-inspired algorithms

Unsupervised Discovery of Spatially-Informed Lung Texture Patterns for Pulmonary Emphysema: The MESA COPD Study.

Obstructive Lung Diseases: Texture Classification for Differentiation at CT.

Lung Image Classification using Locality-Constrained Linear Coding

AE-CNN Classification of Pulmonary Tuberculosis Based on CT Images

Weakly Supervised 3D Classification of Chest CT using Aggregated Multi-Resolution Deep Segmentation Features