Abstract:Segmentation of lung tumors is an important step in the planning of clinical treatment and operative procedures. Automatic segmentation of advanced lung tumors is challenging due to local invasion and heterogeneous metastasis. Fully automatic deep learning models often fail to accurately delineate advanced disease boundaries and do not allow the user to provide hints to improve segmentation performance. In contrast, interactive segmentation accepts user inputs and is an efficient way to segment lesions while reducing radiologist effort. This paper describes an interactive segmentation approach for lung lesion segmentation in CT scans. Our pipeline is built atop the SwinUNETR neural network architecture and can be expanded to support alternate models. The backbone model accepts radiologists' hints in the form of mouse clicks that indicate whether a location on the scan corresponds to a lesion. Our approach has the following novel contributions: (1) Context-aware encoding of guidance clicks by combining geodesic and Gaussian smoothing, resulting in improved segmentation of lesion boundaries. (2) An iterative prompting strategy to achieve higher accuracy with fewer clicks at inference time. (3) Guidance-aware Conditional Random Fields to refine the produced segmentation masks. (4) Volume cropping around guidance clicks at inference to improve segmentation precision and inference speed. (5) Linearly scaling our approach on multiple GPUs, to improve inference speed. On a public non-small cell lung cancer dataset predominantly containing advanced stage cancers (68\% stage III, and 27\% stage IV), our interactive approach delivers a Dice score of 0.74 with a single click, a 21\% improvement from the fully automatic approach (Dice Score = 0.61), and a Dice score of 0.81 with 5 clicks, which is a 33\% improvement. Inference speed is an important metric for an interactive pipeline. On a typical 350 350 150 voxel chest CT scan volume, our interactive approach infers 5 times faster than the original fully automated approach on a single GPU. After scaling to 4 GPUs, we infer in only 0.5 seconds; 20 times faster than the original approach. Qualitative evaluation from three independent radiologists indicates that our interactive pipeline significantly improved their standard clinical segmentation experience. Citation Format: Mayank Patwari, Yi Wei, Meng Xu, Zhenning Zhang, Konstantinos Sidiropoulos, Balaji Selvaraj, Georgia Hughes, Nadine Garibli, Kamsiriochukwu Ojiako, Mohan Lella, Leon Fedden, James Parkin, Michael Parker, Shaneil Patel, Qin Li, Kedar Patwardhan. Fast, interactive, AI-assisted 3D lung tumour segmentation [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular s); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl) nr 887.

A novel panoptic segmentation model for lung tumor prediction using deep learning approaches

A Novel Approach to the Technique of Lung Region Segmentation Based on a Deep Learning Model to Diagnose COVID-19 X-ray Images.

Enhanced lung image segmentation using deep learning

A Method for Real-Time Lung Nodule Instance Segmentation Using Deep Learning

A user-friendly deep learning application for accurate lung cancer diagnosis

An integrated method for detecting lung cancer via CT scanning via optimization, deep learning, and IoT data transmission

An Innovative Method for Lung Cancer Identification Using Machine Learning Algorithms

A Novel Deep Learning Assisted Lung Nodule Identification Mechanism with Intelligent Image Processing Principles

A Hybrid deep learning model for effective segmentation and classification of lung nodules from CT images

Medical Images Segmentation for Lung Cancer Diagnosis Based on Deep Learning Architectures

An efficient combined intelligent system for segmentation and classification of lung cancer computed tomography images

Towards Robust Lung Segmentation in Chest Radiographs with Deep Learning

Automatic Segmentation of Pulmonary Lobes on Low-Dose Computed Tomography Using Deep Learning

Deep Learning with Lung Segmentation and Bone Shadow Exclusion Techniques for Chest X-Ray Analysis of Lung Cancer

Deep Residual U-Net Based Lung Image Segmentation for Lung Disease Detection

Cloud-Based Lung Tumor Detection and Stage Classification Using Deep Learning Techniques

Abstract 887: Fast, interactive, AI-assisted 3D lung tumour segmentation

Lung field segmentation in chest radiographs: a historical review, current status, and expectations from deep learning

Detection-Guided Deep Learning-Based Model with Spatial Regularization for Lung Nodule Segmentation

Computer-Aided Lung Cancer Diagnosis Approaches Based on Deep Learning