Abstract:Background: Rapid On-Site Evaluation (ROSE) during flexible bronchoscopy (FB) can improve the adequacy of biopsy specimens and diagnostic yield of lung cancer. However, the lack of cytopathologists has restricted the wide use of ROSE. Objective: To develop a ROSE artificial intelligence (AI) system using deep learning techniques to differentiate malignant from benign lesions based on ROSE cytological images, and evaluate the clinical performance of the ROSE AI system. Method: 6357 ROSE cytological images from 721 patients who underwent transbronchial biopsy were collected from January to July 2023 at the Tangdu Hospital, Air Force Medical University. A ROSE AI system, composed of a deep convolutional neural network (DCNN), was developed to identify whether there were malignant cells in the ROSE cytological images. Internal testing, external testing, and human-machine competition were used to evaluate the performance of the system. Results: The ROSE AI system identified images containing lung malignant cells with the accuracy of 92.97% and 90.26% on the internal testing dataset and external testing dataset respectively, and its performance was comparable to that of the experienced cytopathologist. The ROSE AI system also showed promising performance in diagnosing lung cancer based on ROSE cytological images, with accuracy of 89.61% and 87.59%, and sensitivity of 90.57% and 94.90% on the internal testing dataset and external testing dataset respectively. More specifically, the agreement between the ROSE AI system and the experienced cytopathologist in diagnosing common types of lung cancer, including squamous cell carcinoma, adenocarcinoma, and small cell lung cancer, demonstrated almost perfect consistency in both the internal testing dataset (κ = 0.930 ) and the external testing dataset (κ = 0.932 ). Conclusions: The ROSE AI system demonstrated feasibility and robustness in identifying specimen adequacy, showing potential enhancement in the diagnostic yield of FB. Nevertheless, additional enhancements, incorporating a more diverse range of training data and leveraging advanced AI models with increased capabilities, along with rigorous validation through extensive multi-center randomized control assays, are crucial to guarantee the seamless and effective integration of this technology into clinical practice.

Automatic lung cancer subtyping using rapid on-site evaluation slides and serum biological markers

The application of artificial intelligence for Rapid On-Site Evaluation during flexible bronchoscopy

Artificial Intelligence-Based Rapid On-Site Cytopathological Evaluation for Bronchoscopy Examinations

Deep Learning‐based Classification and Spatial Prognosis Risk Score on Whole‐slide Images of Lung Adenocarcinoma

Efficacy of Rapid On-Site Cytological Evaluation (ROSE) by a Pulmonologist in Determining Specimen Adequacy and Diagnostic Accuracy in Interventional Diagnosis of Lung Lesions

CUNet3+: A Multi-scale Connected UNet for the Segmentation of Lung Cancer Cells in Pathology Sections Stained Using Rapid On-Site Cytopathological Evaluation

Effectiveness of convolutional neural networks in the interpretation of pulmonary cytologic images in endobronchial ultrasound procedures

A Deep Learning-Based Segmentation System for Rapid Onsite Cytologic Pathology Evaluation of Pancreatic Masses: A Retrospective, Multicenter, Diagnostic Study

Application of Rapid On-Site Evaluation Combined with Flexible Bronchoscopy in the Diagnosis of Lung Lesions

Diagnostic Efficiency and Safety of Rapid On‐site Evaluation Combined with CT‐guided Transthoracic Core Needle Biopsy in Suspected Lung Cancer Patients

Computer-aided diagnosis of lung carcinoma using deep learning - a pilot study

Pancreatic Cancer ROSE Image Classification Based on Multiple Instance Learning with Shuffle Instances

Diagnostic performance of rapid on‐site evaluation during bronchoscopy for lung cancer: A comprehensive meta‐analysis

Robust whole slide image analysis for cervical cancer screening using deep learning

Direct identification of ALK and ROS1 fusions in non-small cell lung cancer from hematoxylin and eosin-stained slides using deep learning algorithms

The investigation of construction and clinical application of image recognition technology assisted bronchoscopy diagnostic model of lung cancer

Rapid On-Site AI-Assisted Grading for Lung Surgery Based on Optical Coherence Tomography

Rapid histology of laryngeal squamous cell carcinoma with deep-learning based stimulated Raman scattering microscopy

Rapid 3D imaging at cellular resolution for digital cytopathology with a multi-camera array scanner (MCAS)

A Clinical Bacterial Dataset for Deep Learning in Microbiological Rapid On-Site Evaluation

Automated Classification of Lung Cancer Subtypes Using Deep Learning and CT-Scan Based Radiomic Analysis