Abstract:Abstract Objectives This study aims to externally validate a commercially available Computer-Aided Detection (CAD)-system for the automatic detection and characterization of solid, part-solid, and ground-glass lung nodules (LN) on CT scans. Methods This retrospective study encompasses 263 chest CT scans performed between January 2020 and December 2021 at a Dutch university hospital. All scans were read by a radiologist (R1) and compared with the initial radiology report. Conflicting scans were assessed by an adjudicating radiologist (R2). All scans were also processed by CAD. The standalone performance of CAD in terms of sensitivity and false-positive (FP)-rate for detection was calculated together with the sensitivity for characterization, including texture, calcification, speculation, and location. The R1’s detection sensitivity was also assessed. Results A total of 183 true nodules were identified in 121 nodule-containing scans (142 non-nodule-containing scans), of which R1 identified 165/183 (90.2%). CAD detected 149 nodules, of which 12 were not identified by R1, achieving a sensitivity of 149/183 (81.4%) with an FP-rate of 49/121 (0.405). CAD’s detection sensitivity for solid, part-solid, and ground-glass LNs was 82/94 (87.2%), 42/47 (89.4%), and 25/42 (59.5%), respectively. The classification accuracy for solid, part-solid, and ground-glass LNs was 81/82 (98.8%), 16/42 (38.1%), and 18/25 (72.0%), respectively. Additionally, CAD demonstrated overall classification accuracies of 137/149 (91.9%), 123/149 (82.6%), and 141/149 (94.6%) for calcification, spiculation, and location, respectively. Conclusions Although the overall detection rate of this system slightly lags behind that of a radiologist, CAD is capable of detecting different LNs and thereby has the potential to enhance a reader’s detection rate. While promising characterization performances are obtained, the tool’s performance in terms of texture classification remains a subject of concern. Clinical relevance statement Numerous lung nodule computer-aided detection-systems are commercially available, with some of them solely being externally validated based on their detection performance on solid nodules. We encourage researchers to assess performances by incorporating all relevant characteristics, including part-solid and ground-glass nodules. Key Points Few computer-aided detection (CAD) systems are externally validated for automatic detection and characterization of lung nodules. A detection sensitivity of 81.4% and an overall texture classification sensitivity of 77.2% were measured utilizing CAD. CAD has the potential to increase single reader detection rate, however, improvement in texture classification is required. Graphical Abstract

Absolute ground truth-based validation of computer-aided nodule detection and volumetry in low-dose CT imaging

Validation of a commercially available CAD-system for lung nodule detection and characterization using CT-scans

"Will I change nodule management recommendations if I change my CAD system?"-impact of volumetric deviation between different CAD systems on lesion management

Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population

Diagnostic validation of a deep learning nodule detection algorithm in low-dose chest CT: determination of optimized dose thresholds in a virtual screening scenario

Effects of tube voltage, radiation dose and adaptive statistical iterative reconstruction strength level on the detection and characterization of pulmonary nodules in ultra-low-dose chest CT

First Performance Evaluation of an Artificial Intelligence-Based Computer-Aided Detection System for Pulmonary Nodule Evaluation in Dual-Source Photon-Counting Detector CT at Different Low-Dose Levels

Pulmonary nodule visualization and evaluation of AI-based detection at various ultra-low-dose levels using photon-counting detector CT

Application of computer-aided detection (CAD) software to automatically detect nodules under SDCT and LDCT scans with different parameters

Assessing the impact of nodule features and software algorithm on pulmonary nodule measurement uncertainty for nodules sized 20 mm or less

Maximum-Intensity-Projection and Computer-Aided-Detection Algorithms as Stand-Alone Reader Devices in Lung Cancer Screening Using Different Dose Levels and Reconstruction Kernels

Detection and Size Measurements of Pulmonary Nodules in Ultra-Low-dose CT with Iterative Reconstruction Compared to Low Dose CT.

Deep Learning-Based Slice Thickness Reduction for Computer-Aided Detection of Lung Nodules in Thick-Slice CT

Detection and size quantification of pulmonary nodules in ultralow-dose versus regular-dose CT: a comparative study in COPD patients

Lung Nodule Detection on Chest CT: Evaluation of a Computer-Aided Detection (CAD) System.

Automated Clinical Target Volume Delineation Using Deep 3D Neural Networks in Radiation Therapy of Non-small Cell Lung Cancer

Observer Sensitivity for Detection of Pulmonary Nodules in Ultra-Low Dose Computed Tomography Protocols Using a Third-Generation Dual-Source CT with Ultra-High Pitch—A Phantom Study

Use of an Anthropomorphic Chest Model to Evaluate Multiple Scanning Protocols for High-Definition and Standard-Definition Computed Tomography to Detect Small Pulmonary Nodules

Detection of pulmonary nodules with scoutless fixed-dose ultra-low-dose CT: a prospective study

Impact of Voxel Normalization on a Machine Learning-Based Method: A Study on Pulmonary Nodule Malignancy Diagnosis Using Low-Dose Computed Tomography (LDCT)

Research Progress of Computer Aided Diagnosis System for Pulmonary Nodules in CT Images.