Abstract:Objective: Automatic and accurate airway segmentation is necessary for lung disease diagnosis. The complex tree-like structures leads to gaps in the different generations of the airway tree, and thus airway segmentation is also considered to be a multi-scale problem. In recent years, convolutional neural networks have facilitated the development of medical image segmentation. In particular, 2D CNNs and 3D CNNs can extract different scale features. Hence, we propose a two-stage and 2D+3D framework for multi-scale airway tree segmentation. Approach: In stage 1, we use a 2D Full Airway SegNet(2D FA-SegNet) to segment the complete airway tree. Multi-scale Atros Spatial Pyramid (MASP) and Atros Residual Skip connection (ARSc) modules are inserted to extract different scales feature. We designed a hard sample selection strategy to increase the proportion of intrapulmonary airway samples in stage 2. 3D Airway RefineNet (3D ARNet) as stage 2 takes the results of stage 1 as a priori information. Spatial information extracted by 3D convolutional kernel compensates for the loss of in 2D FA-SegNet. Furthermore, we added False Positive losses and False Negative losses to improve the segmentation performance of airway branches within the lungs. Main results: We performed data enhancement on the publicly available dataset of ISICDM 2020 Challenge 3, and on which evaluated our method. Comprehensive experiments show that the proposed method has the highest DSC of 0.931, and IoU of 0.871 for the whole airway tree and DSC of 0.699, and IoU of 0.543 for the intrapulmonary bronchi tree. In addition, 3D ARNet proposed in this paper cascaded with other State-Of-The-Art methods to increase DLR by up to 46.33% and DBR by up to 42.97%. Significance: The quantitative and qualitative evaluation results show that our proposed method performs well in segmenting the airway at different scales.

Detail-sensitive 3D-UNet for pulmonary airway segmentation from CT images

C3D-UNET: A Comprehensive 3D Unet for Covid-19 Segmentation with Intact Encoding and Local Attention

Multi-Stage Airway Segmentation in Lung CT Based on Multi-scale Nested Residual UNet

A scale-aware UNet++ model combined with attentional context supervision and adaptive Tversky loss for accurate airway segmentation

An end-to-end multi-scale airway segmentation framework based on pulmonary CT image

A CT-Based Airway Segmentation Using U$^2$-net Trained by the Dice Loss Function

Extraction of Pulmonary Airway in CT Scans Using Deep Fully Convolutional Networks

MSDS-UNet: A Multi-Scale Deeply Supervised 3D U-Net for Automatic Segmentation of Lung Tumor in CT.

Two-stage contextual transformer-based convolutional neural network for airway extraction from CT images

Airway Tree Modeling Using Dual-channel 3D UNet 3+ with Vesselness Prior

A 3D Fusion U-Net with Dual CNN and Transformer Encoders for Lung Airway Segmentation

3D Segmentation of Pulmonary Nodules Based on Multi-View and Semi-Supervised

A dual-path U-Net for pulmonary vessel segmentation method based on lightweight 3D attention

A segmentation method of airway from chest CT image based on VGG-Unet neural network.

A Branch-sensitive 3D Convolutional Neural Networks for Airway Segmentation

MSA-unet: A Multiscale Lightweight U-net Lung CT Image Segmentation Algorithm Under Attention Mechanism

Automatic airway segmentation from Computed Tomography using robust and efficient 3-D convolutional neural networks

Pulmonary CT Nodules Segmentation Using an Enhanced Square U-Net with Depthwise Separable Convolution

Multi-scale Attention and Deep Supervision-Based 3D UNet for Automatic Liver Segmentation from CT.

DSU-Net: Distraction-Sensitive U-Net for 3D lung tumor segmentation

Make it more specific: A novel uncertainty based airway segmentation application on 3D U-Net and its variants