Abstract:Introduction Bronchoscopy is of great significance in diagnosing and treating respiratory illness. Using deep learning, a diagnostic system for bronchoscopy images can improve the accuracy of tracheal, bronchial, and pulmonary disease diagnoses for physicians and ensure timely pathological or etiological examinations for patients. Improving the diagnostic accuracy of the algorithms remains the key to this technology. Objectives To deal with the problem, we proposed a multiscale attention residual network (MARN) for diagnosing lung conditions through bronchoscopic images. The multiscale convolutional block attention module (MCBAM) was designed to enable accurate focus on lesion regions by enhancing spatial and channel features. Gradient-weighted Class Activation Map (Grad-CAM) was provided to increase the interpretability of diagnostic results. Methods We collected 615 cases from Harbin Medical University Cancer Hospital, including 2900 images. The dataset was partitioned randomly into training sets, validation sets and test sets to update model parameters, evaluate the model’s training performance, select network architecture and parameters, and estimate the final model. In addition, we compared MARN with other algorithms. Furthermore, three physicians with different qualifications were invited to diagnose the same test images, and the results were compared to those of the model. Results In the dataset of normal and lesion images, our model displayed an accuracy of 97.76% and an AUC of 99.79%. The model recorded 92.26% accuracy and 96.82% AUC for datasets of benign and malignant lesion images, while it achieved 93.10% accuracy and 99.02% AUC for normal, benign, and malignant lesion images. Conclusion These results demonstrated that our network outperforms other methods in diagnostic performance. The accuracy of our model is roughly the same as that of experienced physicians and the efficiency is much higher than doctors. MARN has great potential for assisting physicians with assessing the bronchoscopic images precisely.

Semi-dense Map Reconstruction of Bronchus Based on Prior Feature Correlation

Building A Dense Surface Map Incrementally from Semi-Dense Point Cloud and Rgb Images

Robust camera localisation with depth reconstruction for bronchoscopic navigation

Landmark Based Bronchoscope Localization for Needle Insertion Under Respiratory Deformation

A Novel SLAM Method for Laparoscopic Scene Reconstruction with Feature Patch Tracking

A Novel Evaluation Method for SLAM-Based 3D Reconstruction of Lumen Panoramas

PANS: Probabilistic Airway Navigation System for Real-time Robust Bronchoscope Localization

A Robust Pose Optimization Scheme With Spatial Geometry Awareness for Hybrid Bronchoscopic Navigation

Sparse-to-dense coarse-to-fine depth estimation for colonoscopy

BronchoTrack: Airway Lumen Tracking for Branch-Level Bronchoscopic Localization

Semi-Direct Multimap SLAM System for Real-Time Sparse 3-D Map Reconstruction

Dense surface reconstruction for enhanced navigation in MIS

BRANCH: Bifurcation Recognition for Airway Navigation based on struCtural cHaracteristics.

An Accurate Prediction for Respiratory Diseases Using Deep Learning on Bronchoscopy Diagnosis Images

Stereo Dense Scene Reconstruction and Accurate Localization for Learning-Based Navigation of Laparoscope in Minimally Invasive Surgery

Weakly Supervised Airway Orifice Segmentation in Video Bronchoscopy

Dense surface reconstruction using a learning-based monocular vSLAM model for laparoscopic surgery

Enhancing Bronchoscopy Depth Estimation through Synthetic-to-Real Domain Adaptation

An Efficient Dense Reconstruction Algorithm from LiDAR and Monocular Camera

Bronchoscopic video synchronization for interactive multimodal inspection of bronchial lesions

Context-Aware Depth and Pose Estimation for Bronchoscopic Navigation.