Abstract:Objectives: There is a need for CT pulmonary angiography (CTPA) lung segmentation models. Clinical translation requires radiological evaluation of model outputs, understanding of limitations, and identification of failure points. This multicentre study aims to develop an accurate CTPA lung segmentation model, with evaluation of outputs in two diverse patient cohorts with pulmonary hypertension (PH) and interstitial lung disease (ILD). Methods: This retrospective study develops an nnU-Net-based segmentation model using data from two specialist centres (UK and USA). Model was trained (n = 37), tested (n = 12), and clinically evaluated (n = 176) on a diverse 'real-world' cohort of 225 PH patients with volumetric CTPAs. Dice score coefficient (DSC) and normalised surface distance (NSD) were used for testing. Clinical evaluation of outputs was performed by two radiologists who assessed clinical significance of errors. External validation was performed on heterogenous contrast and non-contrast scans from 28 ILD patients. Results: A total of 225 PH and 28 ILD patients with diverse demographic and clinical characteristics were evaluated. Mean accuracy, DSC, and NSD scores were 0.998 (95% CI 0.9976, 0.9989), 0.990 (0.9840, 0.9962), and 0.983 (0.9686, 0.9972) respectively. There were no segmentation failures. On radiological review, 82% and 71% of internal and external cases respectively had no errors. Eighteen percent and 25% respectively had clinically insignificant errors. Peripheral atelectasis and consolidation were common causes for suboptimal segmentation. One external case (0.5%) with patulous oesophagus had a clinically significant error. Conclusion: State-of-the-art CTPA lung segmentation model provides accurate outputs with minimal clinical errors on evaluation across two diverse cohorts with PH and ILD. Clinical relevance: Clinical translation of artificial intelligence models requires radiological review and understanding of model limitations. This study develops an externally validated state-of-the-art model with robust radiological review. Intended clinical use is in techniques such as lung volume or parenchymal disease quantification. Key points: • Accurate, externally validated CT pulmonary angiography (CTPA) lung segmentation model tested in two large heterogeneous clinical cohorts (pulmonary hypertension and interstitial lung disease). • No segmentation failures and robust review of model outputs by radiologists found 1 (0.5%) clinically significant segmentation error. • Intended clinical use of this model is a necessary step in techniques such as lung volume, parenchymal disease quantification, or pulmonary vessel analysis.

Longitudinal assessment of interstitial lung abnormalities on CT in patients with COPD using artificial intelligence-based segmentation: a prospective observational study

Artificial intelligence in COPD CT images: identification, staging, and quantitation

External validation, radiological evaluation, and development of deep learning automatic lung segmentation in contrast-enhanced chest CT

Deep learning automated quantification of lung disease in pulmonary hypertension on CT pulmonary angiography: A preliminary clinical study with external validation

Evaluation of AI-Based Segmentation Tools for COVID-19 Lung Lesions on Conventional and Ultra-low Dose CT Scans

Artificial Intelligence for Segmentation and Classification of Lobar, Lobular, and Interstitial Pneumonia Using Case-Specific CT Information.

Deep Learning-based Segmentation of CT Scans Predicts Disease Progression and Mortality in IPF

Interstitial lung abnormalities (ILA) on routine chest CT: Comparison of radiologists' visual evaluation and automated quantification

Computed tomography‐based artificial intelligence in lung disease—Chronic obstructive pulmonary disease

Assessment of artificial intelligence-aided chest computed tomography in diagnosis of chronic obstructive airway disease: an observational study

Interstitial lung disease diagnosis and prognosis using an AI system integrating longitudinal data

CT Quantification of Interstitial Lung Abnormality and Interstitial Lung Disease: From Technical Challenges to Future Directions

Automated Interstitial Lung Abnormality Probability Prediction at CT: A Stepwise Machine Learning Approach in the Boston Lung Cancer Study

From community-acquired pneumonia to COVID-19: a deep learning–based method for quantitative analysis of COVID-19 on thick-section CT scans

An interpretable deep learning workflow for discovering subvisual abnormalities in CT scans of COVID-19 inpatients and survivors

Towards the adoption of quantitative computed tomography in the management of interstitial lung disease

Computer-aided identification of interstitial lung disease based on computed tomography.

AI for Multistructure Incidental Findings and Mortality Prediction at Chest CT in Lung Cancer Screening.

Association of AI quantified COVID-19 chest CT and patient outcome

Application of artificial intelligence-based dual source CT scanning in the differentiation of lung adenocarcinoma in situ and minimally invasive adenocarcinoma

The International Association for the Study of Lung Cancer Early Lung Imaging Confederation Open-Source Deep Learning and Quantitative Measurement Initiative