Abstract:Objective:To construct a deep learning-based artificial intelligence endoscopic ultrasound (EUS) bile duct scanning substation system to assist endoscopists in learning multi-station imaging and improve their operation skills.Methods:A total of 522 EUS videos in Renmin Hospital of Wuhan University and Wuhan Union Hospital from May 2016 to October 2020 were collected, and images were captured from these videos, including 3 000 white light images and 31 003 EUS images from Renmin Hospital of Wuhan University, and 799 EUS images from Wuhan Union Hospital. The pictures were divided into training set and test set in the EUS bile duct scanning system. The system included filtering model of white light gastroscopy images (model 1), distinguishing model of standard station images and non-standard station images (model 2) and substation model of EUS bile duct scanning standard images (model 3), which were used to classify the standard images into liver window, stomach window, duodenal bulb window, and duodenal descending window. Then 110 pictures were randomly selected from the test set for a man-machine competition to compare the accuracy of multi-station imaging by experts, advanced endoscopists and the artificial intelligence model.Results:The accuracies of model 1 and model 2 were 100.00% (1 200/1 200) and 93.36% (2 938/3 147) respectively. Those of model 3 on the internal validation dataset in each classification were 97.23% (1 687/1 735) in liver window, 96.89% (1 681/1 735) in stomach window, 98.73% (1 713/1 735) in duodenal bulb window, and 97.18% (1 686/1 735) in duodenal descending window. And those on the external validation dataset were 89.61% (716/799) in liver window, 92.74% (741/799) in stomach window, 90.11% (720/799) in duodenal bulb window, and 92.24% (737/799) in duodenal descending window. In the man-machine competition, the accuracy of the substation model was 89.09% (98/110), which was higher than that of senior endoscopists [85.45% (94/110), 74.55% (82/110), and 85.45% (94/110)] and close to the level of experts [92.73% (102/110) and 90.00% (99/110)].Conclusion:The deep learning-based EUS bile duct scanning system constructed in the current study can assist endoscopists to perform standard multi-station scanning in real time more accurately and improve the completeness and quality of EUS.

A Deep Learning-Based System for Mediastinum Station Localization in Linear EUS (with Video)

Real-Time Multi-Label Upper Gastrointestinal Anatomy Recognition from Gastroscope Videos

Size-adaptive Mediastinal Multilesion Detection in Chest CT Images Via Deep Learning and a Benchmark Dataset

Deep learning-based pancreas segmentation and station recognition system in EUS: development and validation of a useful training tool (with video)

A deep learning-based system for bile duct annotation and station recognition in linear endoscopic ultrasound

Development of auxiliary substation system for endoscopic ultrasound bile duct scanning based on deep learning

A deep learning–based system to identify originating mural layer of upper gastrointestinal submucosal tumors under EUS

Automatic Segmentation of Mediastinal Lymph Nodes and Blood Vessels in Endobronchial Ultrasound (EBUS) Images Using Deep Learning

Endoscopic ultrasound diagnosis system based on deep learning in images capture and segmentation training of solid pancreatic masses

A Deep Learning-Based, Real-Time Image Report System for Linear EUS.

LNAS: a Clinically Applicable Deep-Learning System for Mediastinal Enlarged Lymph Nodes Segmentation and Station Mapping Without Regard to the Pathogenesis Using Unenhanced CT Images

Automatic Endoscopic Ultrasound Station Recognition with Limited Data

Automated Deep Neural Network-Based Identification, Localization, and Tracking of Cardiac Structures for Ultrasound-Guided Interventional Surgery

Automatic Representative Frame Selection and Intrathoracic Lymph Node Diagnosis with Endobronchial Ultrasound Elastography Videos

Depth Information-Based Automatic Annotation of Early Esophageal Cancers in Gastroscopic Images Using Deep Learning Techniques.

Deep learning-based diagnostic system for gastrointestinal submucosal tumor under endoscopic ultrasonography

Deep Learning System Compared with Expert Endoscopists in Predicting Early Gastric Cancer and Its Invasion Depth and Differentiation Status (with Videos).

Distance Metric-Based Learning with Interpolated Latent Features for Location Classification in Endoscopy Image and Video

TransEBUS: The interpretation of endobronchial ultrasound image using hybrid transformer for differentiating malignant and benign mediastinal lesions

Channel Separation-Based Network for the Automatic Anatomical Site Recognition Using Endoscopic Images.

Artificial Intelligence-Based Diagnosis of Standard Endoscopic Ultrasonography Scanning Sites in the Biliopancreatic System: A Multicenter Retrospective Study