Segmentation of Lung Lesions through Bilateral Learning Branches to Aggregating Contextual and Local Characteristics

Luo, Fengming
DOI: https://doi.org/10.1007/s44196-023-00401-8
IF: 2.259
2024-02-06
International Journal of Computational Intelligence Systems
Abstract:Detecting and analyzing lung lesion regions using artificial intelligence is of great significance in the medical diagnosis of lung CT images, which can substantially improve the efficiency of doctors. However, segmentation of the inflammatory region in the CT image of the lung remains challenging due to the varied sizes, blurry local details, irregular shapes, and limited sizes of datasets. Faced with these challenges, this paper proposes a novel lung lesion segmentation network that incorporates two feature extraction branches to achieve a balance of speed and accuracy. We first design a context branch (CB) to preserve the scale-invariant global context information by the transformer-like module. Besides, a shallow detail branch (DB) based on a deep aggregation pyramid (DAP) module is designed to provide detailed information. Extensive experiments are conducted on two datasets, including the public COVID-19 dataset and a private dataset. Experimental results demonstrate that the proposed method outperforms state-of-the-art methods. Moreover, the trade-off between accuracy and inference speed is achieved.
computer science, artificial intelligence, interdisciplinary applications
What problem does this paper attempt to address?
The paper mainly addresses the detection and analysis of lung lesion areas (especially interstitial pneumonia) in computed tomography (CT) images. The authors propose a new lung lesion segmentation network aimed at solving the following issues: 1. **Diversity and complexity of lesion areas**: Lung inflammation areas vary greatly in size, local details, and shape, posing challenges for the precise segmentation of lesion areas. 2. **Dataset limitations**: Available datasets are usually limited in size, which is an obstacle for artificial intelligence models that rely on a large number of training samples. To address the above issues, the paper proposes a learning framework with two branches: **Context Branch (CB)** and **Detail Branch (DB)**. Specifically: - **Context Branch (CB)**: Designed based on transformer-like modules, it is used to retain global context information and obtain scale-invariant features through dilated convolutions. - **Detail Branch (DB)**: Constructed based on the Deep Aggregation Pyramid (DAP) module, it is used to capture local detail information. Additionally, to balance accuracy and inference speed, the paper employs a series of technical means, including an improved RepVGG network structure and a multi-layer perceptron (MLP)-based feature fusion method. Experimental results show that the proposed network outperforms existing advanced methods on both public COVID-19 datasets and private interstitial pneumonia datasets.