Clinical Evaluation of Medical Image Synthesis: A Case Study in Wireless Capsule Endoscopy

Panagiota Gatoula,Dimitrios E. Diamantis,Anastasios Koulaouzidis,Cristina Carretero,Stefania Chetcuti-Zammit,Pablo Cortegoso Valdivia,Begoña González-Suárez,Alessandro Mussetto,John Plevris,Alexander Robertson,Bruno Rosa,Ervin Toth,Dimitris K. Iakovidis
2024-11-01
Abstract:Sharing retrospectively acquired data is essential for both clinical research and training. Synthetic Data Generation (SDG), using Artificial Intelligence (AI) models, can overcome privacy barriers in sharing clinical data, enabling advancements in medical diagnostics. This study focuses on the clinical evaluation of medical SDG, with a proof-of-concept investigation on diagnosing Inflammatory Bowel Disease (IBD) using Wireless Capsule Endoscopy (WCE) images. The paper contributes by a) presenting a protocol for the systematic evaluation of synthetic images by medical experts and b) applying it to assess TIDE-II, a novel variational autoencoder-based model for high-resolution WCE image synthesis, with a comprehensive qualitative evaluation conducted by 10 international WCE specialists, focusing on image quality, diversity, realism, and clinical decision-making. The results show that TIDE-II generates clinically relevant WCE images, helping to address data scarcity and enhance diagnostic tools. The proposed protocol serves as a reference for future research on medical image-generation techniques.
Computer Vision and Pattern Recognition,Artificial Intelligence,Image and Video Processing
What problem does this paper attempt to address?
The main problems that this paper attempts to solve are: 1. **The contradiction between privacy protection and data sharing**: In clinical research and training, sharing retrospectively - obtained data is crucial, but privacy regulations (such as the General Data Protection Regulation, GDPR) pose significant obstacles to the sharing of clinical data. Synthetic data generation (SDG) technology using artificial intelligence models can overcome these privacy barriers, thus promoting the progress of medical diagnosis. 2. **The inefficiency problem of wireless capsule endoscopy (WCE) images in the diagnosis of inflammatory bowel disease (IBD)**: Currently, the effectiveness of WCE in the diagnosis of IBD is not satisfactory, especially in small - intestine examinations, which require a lot of time and are prone to misdiagnosis due to doctor fatigue. By generating high - quality synthetic WCE images, the diagnostic effect can be improved and more training resources can be provided for doctors. Specifically, this research focuses on the following aspects: - **Proposing a clinical evaluation protocol for synthetic images (CEMIS)**: This protocol aims to comprehensively evaluate the quality, diversity, authenticity and clinical decision - support ability of synthetic images. - **Applying a new variational auto - encoder (VAE) architecture TIDE - II to generate high - resolution WCE images**: TIDE - II is an improved deep - learning model that can generate high - resolution images four times that of previous studies, significantly improving the authenticity and diversity of images. - **Conducting detailed clinical evaluations by an international expert team**: 10 WCE experts from different countries qualitatively and quantitatively evaluated the synthetic images generated by TIDE - II according to the proposed CEMIS protocol, with a focus on image quality, anatomical structure accuracy and diagnostic difficulty. In conclusion, this research aims to fill the gaps in existing synthetic image evaluation protocols, especially for the image generation quality evaluation in complex pathological conditions (such as IBD), and to provide a reference standard for future research.