Abstract:Objective To establish an artificial intelligence deep learning model using clinical colonoscopy images and video to assist the diagnosis by colonoscopy. Methods More than 600000 colonoscopy images were collected in endoscopic center of the Second Affiliated Hospital of Zhejiang University School of Medicine from 2014 to 2018, and endoscopic experts recorded a large number of high-quality operation video of colonoscopy as analysis data. After repeated discussion by six experts, the classified intestinal sites and pathological features were determined, and fuzzy and confusable images were deleted. The final selection result was approximately 1 out of 4. And then the features of images were marked using an independently developed software. The deep learning algorithm was developed using TensorFlow platform of Google. Results After repeated comparison and analysis of the results of machine training and judgment results combined with pathology from endoscopic experts, the sensitivity of the model for some diseases ( such as colon polyps) was 99％ under laboratory conditions. In the clinical colonoscopy test, the sensitivity, specificity, and overall accuracy of this model for diagnosis of colon polyps were 98. 30％(4187/4259), 88. 10％ (17620/20000), and 92. 92％ [2×98. 30％×88. 10％/(98. 30％+88. 10％)], respectively. The sensitivity and specificity for ulcerative colitis were 78. 32％ ( 2671/3410) , and 67. 06％(13412/20000), respectively. The diagnosis time spent on a single image was 0. 5±0. 03 s, and it was the real time for application, including system recognition, text prompt in video image, background record and storage. Conclusion The artificial intelligence assisted diagnosis model developed by our team can identify colonic polyps, colorectal cancer, colorectal eminence, colonic diverticulum, ulcerative colitis, etc. The auxiliary diagnosis model of colon disease can guide beginners to carry out colonoscopy, and can improve lesion detection rate, reduce misdiagnosis rate, and improve the overall operating efficiency of endoscopic center, which is conducive to the quality control of colonoscopy.

Semi-Supervised Detection Model Based on Adaptive Ensemble Learning for Medical Images

Construction of Artificial Intelligence Assisted Diagnosis Model for Colonoscopy

An Adaptive Regularization Approach to Colonoscopic Polyp Detection Using a Cascaded Structure of Encoder–Decoders

Feature-enhanced Adversarial Semi-supervised Semantic Segmentation Network for Pulmonary Embolism Annotation

Deep virtual adversarial self-training with consistency regularization for semi-supervised medical image classification

Semi-supervised Medical Image Classification with Relation-driven Self-ensembling Model

Robust and accurate pulmonary nodule detection with self-supervised feature learning on domain adaptation

Weakly and Semi Supervised Detection in Medical Imaging via Deep Dual Branch Net

Deep Semi-supervised Metric Learning with Dual Alignment for Cervical Cancer Cell Detection

Automatic detection of small bowel lesions with different bleeding risks based on deep learning models

Semi-Supervised Adversarial Learning For Diabetic Retinopathy Screening

FocalMix: Semi-Supervised Learning for 3D Medical Image Detection

Weakly Semi-Supervised Detection in Lung Ultrasound Videos

Deep Learning Assisted Efficient AdaBoost Algorithm for Breast Cancer Detection and Early Diagnosis

Self-supervised learning and semi-supervised learning for multi-sequence medical image classification

Detection and Recognition of Ultrasound Breast Nodules Based on Semi-supervised deep learning

Class-balanced Open-set Semi-supervised Object Detection for Medical Images

Semi-Supervised Medical Image Classification Combined with Unsupervised Deep Clustering

SSMD: Semi-Supervised medical image detection with adaptive consistency and heterogeneous perturbation

Medical Image Classification Based on Semi-Supervised Generative Adversarial Network and Pseudo-Labelling

Semi-supervised learning for breast-ultrasound image