Abstract:The successful integration of neural networks in a clinical setting is still uncommon despite major successes achieved by artificial intelligence in other domains. This is mainly due to the black box characteristic of most optimized models and the undetermined generalization ability of the trained architectures. The current work tackles both issues in the radiology domain by focusing on developing an effective and interpretable cardiomegaly detection architecture based on segmentation models. The architecture consists of two distinct neural networks performing the segmentation of both cardiac and thoracic areas of a radiograph. The respective segmentation outputs are subsequently used to estimate the cardiothoracic ratio, and the corresponding radiograph is classified as a case of cardiomegaly based on a given threshold. Due to the scarcity of pixel-level labeled chest radiographs, both segmentation models are optimized in a semi-supervised manner. This results in a significant reduction in the costs of manual annotation. The resulting segmentation outputs significantly improve the interpretability of the architecture's final classification results. The generalization ability of the architecture is assessed in a cross-domain setting. The assessment shows the effectiveness of the semi-supervised optimization of the segmentation models and the robustness of the ensuing classification architecture.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to improve the efficiency and accuracy of cardiomegaly detection, while enhancing the interpretability of the detection results. Specifically, the paper proposes a semi - supervised learning method based on segmentation to estimate the Cardiothoracic Ratio (CTR), and automatically detect cardiomegaly by setting a threshold. This method aims to overcome the performance degradation of existing methods in cross - domain settings and reduce the dependence on a large amount of manually - labeled data, thereby reducing costs and improving the generalization ability of the model. ### Main problems 1. **Improve the efficiency and accuracy of cardiomegaly detection**: - Existing methods for cardiomegaly detection usually rely on experts' knowledge for the calculation and interpretation of the Cardiothoracic Ratio, which is not only time - consuming but also susceptible to subjective factors. - The paper proposes a deep - learning method based on segmentation to detect cardiomegaly by automatically calculating the Cardiothoracic Ratio, thereby improving the efficiency and accuracy of detection. 2. **Enhance the interpretability of detection results**: - Many existing deep - learning models are regarded as "black boxes", with their internal operating mechanisms being opaque, resulting in difficult - to - interpret results. - The paper makes the final classification results more intuitive and interpretable by using a segmentation model to generate segmentation masks for the heart and thoracic regions. 3. **Reduce the dependence on a large amount of manually - labeled data**: - Manually labeling pixel - level labels for chest X - rays is a time - consuming and costly task. - The paper adopts a semi - supervised learning method, using a small amount of labeled data and a large amount of unlabeled data to optimize the segmentation model, thereby significantly reducing the cost of manual labeling. 4. **Improve the generalization ability of the model**: - Existing methods for cardiomegaly detection often perform poorly in cross - domain settings, that is, the performance on different datasets will significantly decline. - The paper verifies the robustness and generalization ability of the proposed method under different data distributions by evaluating the performance of the model on multiple different datasets. ### Method overview The architecture proposed in the paper consists of two main parts: 1. **Segmentation model**: - Use two neural networks to segment the heart and thoracic regions respectively. - The segmentation output is used to calculate the Cardiothoracic Ratio (CTR). 2. **Semi - supervised learning**: - Use a small amount of labeled data and a large amount of unlabeled data to optimize the segmentation model. - Through the Cross - Consistency Training method, enhance the generalization ability and robustness of the model. ### Formulas - **Calculation formula of Cardiothoracic Ratio (CTR)**: \[ \text{CTR}=\frac{\text{Maximum horizontal diameter of the heart}}{\text{Maximum horizontal diameter of the thorax}} \] - **Classification threshold**: \[ \text{Output}=\begin{cases} \text{Cardiomegaly}&\text{if }\text{CTR}>\pi\\ \text{Normal}&\text{otherwise} \end{cases} \] - **Loss function**: - Supervised loss \(L_S\): \[ L_S = \frac{1}{bs_l}\sum_{i = 1}^{bs_l}(H(y_l^i,\hat{y}_l^i)+\text{dice}(y_l^i,\hat{y}_l^i)) \] - Unsupervised loss \(L_U\): \[ L_U=\frac{1}{k\times bs_u}\sum_{j = 1}^{bs_u}\sum_{p = 1}^{k}d(\hat{y}_u^j,\hat{y}_{u,p}^j) \] - Total loss \(L\): \[ L = L_S+\omega_U L_U \] - Pixel - level squared error \(d\)

Segmentation-based cardiomegaly detection based on semi-supervised estimation of cardiothoracic ratio

A Fully Automated Two-Stage Segmentation Approach for Late Gadolinium-Enhanced Cardiac Magnetic Resonance Images in Personalized Cardiac Modeling

Deep Learning Models for Calculation of Cardiothoracic Ratio from Chest Radiographs for Assisted Diagnosis of Cardiomegaly

Evaluation of the feasibility of explainable computer-aided detection of cardiomegaly on chest radiographs using deep learning

Fully Convolutional Architectures for Multi-Class Segmentation in Chest Radiographs

Unsupervised domain adaptation for the detection of cardiomegaly in cross-domain chest X-ray images

A Deep Learning System for Detecting Cardiomegaly Disease Based on CXR Image

Deep Learning in Cardiothoracic Ratio Calculation and Cardiomegaly Detection

Semi-Supervised Segmentation of Multi-vendor and Multi-center Cardiac MRI using Histogram Matching

Identifying cardiomegaly in chest x-rays using dual attention network

Chest X-Ray Image Analysis With Combining 2D and 1D Convolutional Neural Network Based Classifier for Rapid Cardiomegaly Screening

Cardiomegaly Detection using Deep Convolutional Neural Network with U-Net

Deep learning-based automatic segmentation of images in cardiac radiography: A promising challenge

Bayesian Feature Pyramid Networks for Automatic Multi-Label Segmentation of Chest X-rays and Assessment of Cardio-Thoratic Ratio

Posteroanterior Chest X-ray Image Classification with a Multilayer 1D Convolutional Neural Network-Based Classifier for Cardiomegaly Level Screening

End-to-End Diagnosis and Segmentation Learning from Cardiac Magnetic Resonance Imaging

Combining generative modelling and semi-supervised domain adaptation for whole heart cardiovascular magnetic resonance angiography segmentation

Fully Automatic initialization and segmentation of left and right ventricles for large-scale cardiac MRI using a deeply supervised network and 3D-ASM

Automatic Cardiac Disease Assessment on cine-MRI via Time-Series Segmentation and Domain Specific Features

Designing a computer-assisted diagnosis system for cardiomegaly detection and radiology report generation

Reducing segmentation failures in cardiac MRI via Late feature fusion and GAN-based augmentation