Abstract:Abstract Objectives This study aims to externally validate a commercially available Computer-Aided Detection (CAD)-system for the automatic detection and characterization of solid, part-solid, and ground-glass lung nodules (LN) on CT scans. Methods This retrospective study encompasses 263 chest CT scans performed between January 2020 and December 2021 at a Dutch university hospital. All scans were read by a radiologist (R1) and compared with the initial radiology report. Conflicting scans were assessed by an adjudicating radiologist (R2). All scans were also processed by CAD. The standalone performance of CAD in terms of sensitivity and false-positive (FP)-rate for detection was calculated together with the sensitivity for characterization, including texture, calcification, speculation, and location. The R1’s detection sensitivity was also assessed. Results A total of 183 true nodules were identified in 121 nodule-containing scans (142 non-nodule-containing scans), of which R1 identified 165/183 (90.2%). CAD detected 149 nodules, of which 12 were not identified by R1, achieving a sensitivity of 149/183 (81.4%) with an FP-rate of 49/121 (0.405). CAD’s detection sensitivity for solid, part-solid, and ground-glass LNs was 82/94 (87.2%), 42/47 (89.4%), and 25/42 (59.5%), respectively. The classification accuracy for solid, part-solid, and ground-glass LNs was 81/82 (98.8%), 16/42 (38.1%), and 18/25 (72.0%), respectively. Additionally, CAD demonstrated overall classification accuracies of 137/149 (91.9%), 123/149 (82.6%), and 141/149 (94.6%) for calcification, spiculation, and location, respectively. Conclusions Although the overall detection rate of this system slightly lags behind that of a radiologist, CAD is capable of detecting different LNs and thereby has the potential to enhance a reader’s detection rate. While promising characterization performances are obtained, the tool’s performance in terms of texture classification remains a subject of concern. Clinical relevance statement Numerous lung nodule computer-aided detection-systems are commercially available, with some of them solely being externally validated based on their detection performance on solid nodules. We encourage researchers to assess performances by incorporating all relevant characteristics, including part-solid and ground-glass nodules. Key Points Few computer-aided detection (CAD) systems are externally validated for automatic detection and characterization of lung nodules. A detection sensitivity of 81.4% and an overall texture classification sensitivity of 77.2% were measured utilizing CAD. CAD has the potential to increase single reader detection rate, however, improvement in texture classification is required. Graphical Abstract

A computer-aided diagnosis system for detection of lung nodules in chest radiographs with an evaluation on a public database

Automated detection of lung nodules in CT scans: Preliminary results

Design Computer-Aided Diagnosis System Based on Chest CT Evaluation of Pulmonary Nodules

Computer-Assisted Image Processing System for Early Assessment of Lung Nodule Malignancy

Lung nodule detection in low-dose and thin-slice computed tomography

Lung Nodule Detection on Chest CT: Evaluation of a Computer-Aided Detection (CAD) System.

Evaluation of an Algorithm for the Segmentation of Lung Nodules in Computerized Tomography Images Based on the Automatic Location of a Threshold

High precision localization of pulmonary nodules on chest CT utilizing axial slice number labels

Identifying pulmonary nodules or masses on chest radiography using deep learning: external validation and strategies to improve clinical practice

Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population

Lung nodule detection in low-dose and high-resolution CT scans

Application value of a computer-aided diagnosis and management system for the detection of lung nodules

Detection of Small Pulmonary Nodules Using Direct Digital Radiography and Picture Archiving and Communication Systems

Performance of artificial intelligence-based software for the automatic detection of lung lesions on chest radiographs of patients with suspected lung cancer

Study of automatic detection algorithm for lung nodules

An adaptive lung nodule detection algorithm

Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge

Autonomous Detection of Solitary Pulmonary Nodules on CT Images for Computer-Aided Diagnosis

Computer Aided Lung Nodule Detection on CT Data

Validation of a commercially available CAD-system for lung nodule detection and characterization using CT-scans

Pulmonary nodules detection assistant platform: An effective computer aided system for early pulmonary nodules detection in physical examination