A novel deep learning-based computer-aided diagnosis system for predicting inflammatory activity in ulcerative colitis
Yanyun Fan,Ruochen Mu,Hongzhi Xu,Chenxi Xie,Yinghao Zhang,Lupeng Liu,Lin Wang,Huaxiu Shi,Yiqun Hu,Jianlin Ren,Jing Qin,Liansheng Wang,Shuntian Cai
DOI: https://doi.org/10.1016/j.gie.2022.08.015
IF: 10.396
2022-08-18
Gastrointestinal Endoscopy
Abstract:Background and Aims Endoscopy is increasingly performed for evaluating patients with ulcerative colitis (UC). However, its diagnostic accuracy is largely affected by the subjectivity of endoscopists' experience and scoring methods, and scoring of selected endoscopic images cannot reflect the inflammation of the whole intestine. We aimed to develop an automatic scoring system using deep-learning technology for consistent and objective scoring of endoscopic images and full-length endoscopic videos of patients with UC. Methods We collected 5,875 endoscopic images and 20 full-length videos from 332 patients with UC who underwent colonoscopy between January 2017 and March 2021. We trained the artificial-intelligence (AI) scoring system using these images, which was then used for full-length videos scoring. In order to more accurately assess and visualize the full-length intestinal inflammation, we divided the large intestine into a fixed number of "areas" (cecum: 20, transverse colon: 20, descending colon: 20, sigmoid colon: 15, rectum: 10). The scoring system automatically scored inflammatory severity of 85 areas from every video and generated a visualized result of full-length intestine inflammatory activity. Results Compared to endoscopist scoring, the trained convolutional neural network achieved 86.54% accuracy in the Mayo-scored task, while the Kappa coefficient was 0.813 (95% CI, 0.782-0.844). The metrics of the Ulcerative Colitis Endoscopic Index of Severity(UCEIS)-scored task were encouraging, with accuracies of 90.7%, 84.6%, and 77.7%, and Kappa coefficients of 0.822 (95% CI, 0.788-0.855), 0.784 (95% CI, 0.744-0.823), and 0.702 (95% CI, 0.612-0.793) for vascular pattern, erosions-and-ulcers, and bleeding, respectively. The AI scoring system predicted each bowel segment's score and displayed distribution of inflammatory activity in the whole large intestine via a 2D colorized image. Conclusions We established a novel deep-learning based scoring system to evaluate endoscopic images from patients with UC, which can also accurately describe the severity and distribution of inflammatory activity through full-length intestinal endoscopic videos.
gastroenterology & hepatology