Applying the transtheoretical model to a representative sample of smokers.

J. Fava,W. Velicer,J. Prochaska

DOI: https://doi.org/10.1016/0306-4603(94)00062-X

1995-03-01

Abstract:

What problem does this paper attempt to address?

Evaluating clinical diversity and plausibility of synthetic capsule endoscopic images

Anuja Vats,Marius Pedersen,Ahmed Mohammed,Øistein Hovde

DOI: https://doi.org/10.1038/s41598-023-36883-x

2023-01-16

Abstract:Wireless Capsule Endoscopy (WCE) is being increasingly used as an alternative imaging modality for complete and non-invasive screening of the gastrointestinal tract. Although this is advantageous in reducing unnecessary hospital admissions, it also demands that a WCE diagnostic protocol be in place so larger populations can be effectively screened. This calls for training and education protocols attuned specifically to this modality. Like training in other modalities such as traditional endoscopy, CT, MRI, etc., a WCE training protocol would require an atlas comprising of a large corpora of images that show vivid descriptions of pathologies and abnormalities, ideally observed over a period of time. Since such comprehensive atlases are presently lacking in WCE, in this work, we propose a deep learning method for utilizing already available studies across different institutions for the creation of a realistic WCE atlas using StyleGAN. We identify clinically relevant attributes in WCE such that synthetic images can be generated with selected attributes on cue. Beyond this, we also simulate several disease progression scenarios. The generated images are evaluated for realism and plausibility through three subjective online experiments with the participation of eight gastroenterology experts from three geographical locations and a variety of years of experience. The results from the experiments indicate that the images are highly realistic and the disease scenarios plausible. The images comprising the atlas are available publicly for use in training applications as well as supplementing real datasets for deep learning.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Clinical Evaluation of Medical Image Synthesis: A Case Study in Wireless Capsule Endoscopy

Panagiota Gatoula,Dimitrios E. Diamantis,Anastasios Koulaouzidis,Cristina Carretero,Stefania Chetcuti-Zammit,Pablo Cortegoso Valdivia,Begoña González-Suárez,Alessandro Mussetto,John Plevris,Alexander Robertson,Bruno Rosa,Ervin Toth,Dimitris K. Iakovidis

2024-11-01

Abstract:Sharing retrospectively acquired data is essential for both clinical research and training. Synthetic Data Generation (SDG), using Artificial Intelligence (AI) models, can overcome privacy barriers in sharing clinical data, enabling advancements in medical diagnostics. This study focuses on the clinical evaluation of medical SDG, with a proof-of-concept investigation on diagnosing Inflammatory Bowel Disease (IBD) using Wireless Capsule Endoscopy (WCE) images. The paper contributes by a) presenting a protocol for the systematic evaluation of synthetic images by medical experts and b) applying it to assess TIDE-II, a novel variational autoencoder-based model for high-resolution WCE image synthesis, with a comprehensive qualitative evaluation conducted by 10 international WCE specialists, focusing on image quality, diversity, realism, and clinical decision-making. The results show that TIDE-II generates clinically relevant WCE images, helping to address data scarcity and enhance diagnostic tools. The proposed protocol serves as a reference for future research on medical image-generation techniques.

Computer Vision and Pattern Recognition,Artificial Intelligence,Image and Video Processing
This Intestine Does Not Exist: Multiscale Residual Variational Autoencoder for Realistic Wireless Capsule Endoscopy Image Generation

Dimitrios E. Diamantis,Panagiota Gatoula,Anastasios Koulaouzidis,Dimitris K. Iakovidis

DOI: https://doi.org/10.1109/access.2024.3366801

IF: 3.9

2024-02-28

IEEE Access

Abstract:Medical image synthesis has emerged as a promising solution to address the limited availability of annotated medical data needed for training machine learning algorithms in the context of image-based Clinical Decision Support (CDS) systems. To this end, Generative Adversarial Networks (GANs) have been mainly applied to support the algorithm training process by generating synthetic images for data augmentation. However, in the field of Wireless Capsule Endoscopy (WCE), the limited content diversity and size of existing publicly available annotated datasets adversely affect both the training stability and synthesis performance of GANs. In this paper a novel Variational Autoencoder (VAE) architecture is proposed for WCE image synthesis, namely 'This Intestine Does not Exist' (TIDE). This is the first VAE architecture comprising multiscale feature extraction convolutional blocks and residual connections. Its advantage is that it enables the generation of high-quality and diverse datasets even with a limited number of training images. Contrary to the current approaches, which are oriented towards the augmentation of the available datasets, this study demonstrates that using TIDE, real WCE datasets can be fully substituted by artificially generated ones, without compromising classification performance of CDS. It performs a spherical experimental evaluation study that covers both quantitative and qualitative aspects, including a user evaluation study performed by WCE specialists, which validate from a medical viewpoint that both the normal and abnormal WCE images synthesized by TIDE are sufficiently realistic. The quantitative results obtained by comparative experiments validate that the proposed architecture outperforms the state-of-the-art.

computer science, information systems,telecommunications,engineering, electrical & electronic
OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Yulin Yang,Jing Liu,Gan Zhan,Qingqing Chen,Fang Wang,Yinhao Li,Rahul Kumar Jain,Lanfen Lin,Hongjie Hu,Yen-Wei Chen

DOI: https://doi.org/10.1088/2057-1976/ad31fa

2024-01-01

Biomedical Physics & Engineering Express

Abstract:Contrast-enhanced computed tomography (CE-CT) images are vital for clinical diagnosis of focal liver lesions (FLLs). However, the use of CE-CT images imposes a significant burden on patients due to the injection of contrast agents and extended shooting. Deep learning-based image synthesis models offer a promising solution that synthesizes CE-CT images from non-contrasted CT (NC-CT) images. Unlike natural images, medical image synthesis requires a specific focus on certain organs or localized regions to ensure accurate diagnosis. Determining how to effectively emphasize target organs poses a challenging issue in medical image synthesis. To solve this challenge, we present a novel CE-CT image synthesis model called, Organ-Aware Generative Adversarial Network (OA-GAN). The OA-GAN comprises an organ-aware (OA) network and a dual decoder-based generator. First, the OA network learns the most discriminative spatial features about the target organ (i.e. liver) by utilizing the ground truth organ mask as localization cues. Subsequently, NC-CT image and captured feature are fed into the dual decoder-based generator, which employs a local and global decoder network to simultaneously synthesize the organ and entire CECT image. Moreover, the semantic information extracted from the local decoder is transferred to the global decoder to facilitate better reconstruction of the organ in entire CE-CT image. The qualitative and quantitative evaluation on a CE-CT dataset demonstrates that the OA-GAN outperforms state-of-the-art approaches for synthesizing two types of CE-CT images such as arterial phase and portal venous phase. Additionally, subjective evaluations by expert radiologists and a deep learning-based FLLs classification also affirm that CE-CT images synthesized from the OA-GAN exhibit a remarkable resemblance to real CE-CT images.
Color-Transfer-Enhanced Data Construction and Validation for Deep Learning-Based Upper Gastrointestinal Landmark Classification in Wireless Capsule Endoscopy

Hyeon-Seo Kim,Byungwoo Cho,Jong-Oh Park,Byungjeon Kang

DOI: https://doi.org/10.3390/diagnostics14060591

IF: 3.6

2024-03-12

Diagnostics

Abstract:While the adoption of wireless capsule endoscopy (WCE) has been steadily increasing, its primary application remains limited to observing the small intestine, with relatively less application in the upper gastrointestinal tract. However, there is a growing anticipation that advancements in capsule endoscopy technology will lead to a significant increase in its application in upper gastrointestinal examinations. This study addresses the underexplored domain of landmark identification within the upper gastrointestinal tract using WCE, acknowledging the limited research and public datasets available in this emerging field. To contribute to the future development of WCE for gastroscopy, a novel approach is proposed. Utilizing color transfer techniques, a simulated WCE dataset tailored for the upper gastrointestinal tract is created. Using Euclidean distance measurements, the similarity between this color-transferred dataset and authentic WCE images is verified. Pioneering the exploration of anatomical landmark classification with WCE data, this study integrates similarity evaluation with image preprocessing and deep learning techniques, specifically employing the DenseNet169 model. As a result, utilizing the color-transferred dataset achieves an anatomical landmark classification accuracy exceeding 90% in the upper gastrointestinal tract. Furthermore, the application of sharpen and detail filters demonstrates an increase in classification accuracy from 91.32% to 94.06%.

medicine, general & internal
Semantic Map Guided Synthesis of Wireless Capsule Endoscopy Images using Diffusion Models

Haejin Lee,Jeongwoo Ju,Jonghyuck Lee,Yeoun Joo Lee,Heechul Jung

2023-11-10

Abstract:Wireless capsule endoscopy (WCE) is a non-invasive method for visualizing the gastrointestinal (GI) tract, crucial for diagnosing GI tract diseases. However, interpreting WCE results can be time-consuming and tiring. Existing studies have employed deep neural networks (DNNs) for automatic GI tract lesion detection, but acquiring sufficient training examples, particularly due to privacy concerns, remains a challenge. Public WCE databases lack diversity and quantity. To address this, we propose a novel approach leveraging generative models, specifically the diffusion model (DM), for generating diverse WCE images. Our model incorporates semantic map resulted from visualization scale (VS) engine, enhancing the controllability and diversity of generated images. We evaluate our approach using visual inspection and visual Turing tests, demonstrating its effectiveness in generating realistic and diverse WCE images.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Capsule Endoscopy Image Classification with Deep Convolutional Neural Networks

Yaxing Cao,Wenming Yang,Kaiquan Chen,Yong Ren,Qingmin Liao

DOI: https://doi.org/10.1109/CompComm.2018.8780859

2018-01-01

Abstract:Wireless capsule endoscopy (WCE) is quite an advanced, patient-friendly and novel medical equipment for non-invasive gastrointestinal disease detection, which is able to view the entire gastrointestinal tract without pain. Since there are more than 80,000 WCE images for each examination, it usually takes hours for professional clinicians to diagnose all the video data. Therefore, the automatic computer-aided lesion classification technique is highly perspective needed. In this paper, we propose an effective scheme to classify different lesion images acquired by WCE. Firstly, we obtain feature maps of the same resolution by performing a max pooling operation on different convolutional layers, and then quantify the pooled feature maps by trainable weight parameters, and finally one by one convolution kernels are employed to merge the combined quantized feature maps. We enhance the performance of feature extraction by merging multi-level convolutional features, including both low level and high level features. The preliminary experimental result shows that the classification accuracy rate is up to 95.15%, both running speed and recognition rate are higher than traditional machine learning algorithms.
Deep Learning-Based Real-Time Organ Localization and Transit Time Estimation in Wireless Capsule Endoscopy

Seung-Joo Nam,Gwiseong Moon,Jung-Hwan Park,Yoon Kim,Yun Jeong Lim,Hyun-Soo Choi

DOI: https://doi.org/10.3390/biomedicines12081704

IF: 4.757

2024-07-31

Biomedicines

Abstract:Background: Wireless capsule endoscopy (WCE) has significantly advanced the diagnosis of gastrointestinal (GI) diseases by allowing for the non-invasive visualization of the entire small intestine. However, machine learning-based methods for organ classification in WCE often rely on color information, leading to decreased performance when obstacles such as food debris are present. This study proposes a novel model that integrates convolutional neural networks (CNNs) and long short-term memory (LSTM) networks to analyze multiple frames and incorporate temporal information, ensuring that it performs well even when visual information is limited. Methods: We collected data from 126 patients using PillCam™ SB3 (Medtronic, Minneapolis, MN, USA), which comprised 2,395,932 images. Our deep learning model was trained to identify organs (stomach, small intestine, and colon) using data from 44 training and 10 validation cases. We applied calibration using a Gaussian filter to enhance the accuracy of detecting organ boundaries. Additionally, we estimated the transit time of the capsule in the gastric and small intestine regions using a combination of a convolutional neural network (CNN) and a long short-term memory (LSTM) designed to be aware of the sequence information of continuous videos. Finally, we evaluated the model's performance using WCE videos from 72 patients. Results: Our model demonstrated high performance in organ classification, achieving an accuracy, sensitivity, and specificity of over 95% for each organ (stomach, small intestine, and colon), with an overall accuracy and F1-score of 97.1%. The Matthews Correlation Coefficient (MCC) and Geometric Mean (G-mean) were used to evaluate the model's performance on imbalanced datasets, achieving MCC values of 0.93 for the stomach, 0.91 for the small intestine, and 0.94 for the colon, and G-mean values of 0.96 for the stomach, 0.95 for the small intestine, and 0.97 for the colon. Regarding the estimation of gastric and small intestine transit times, the mean time differences between the model predictions and ground truth were 4.3 ± 9.7 min for the stomach and 24.7 ± 33.8 min for the small intestine. Notably, the model's predictions for gastric transit times were within 15 min of the ground truth for 95.8% of the test dataset (69 out of 72 cases). The proposed model shows overall superior performance compared to a model using only CNN. Conclusions: The combination of CNN and LSTM proves to be both accurate and clinically effective for organ classification and transit time estimation in WCE. Our model's ability to integrate temporal information allows it to maintain high performance even in challenging conditions where color information alone is insufficient. Including MCC and G-mean metrics further validates the robustness of our approach in handling imbalanced datasets. These findings suggest that the proposed method can significantly improve the diagnostic accuracy and efficiency of WCE, making it a valuable tool in clinical practice for diagnosing and managing GI diseases.
LLCaps: Learning to Illuminate Low-Light Capsule Endoscopy with Curved Wavelet Attention and Reverse Diffusion

Long Bai,Tong Chen,Yanan Wu,An Wang,Mobarakol Islam,Hongliang Ren

2023-07-22

Abstract:Wireless capsule endoscopy (WCE) is a painless and non-invasive diagnostic tool for gastrointestinal (GI) diseases. However, due to GI anatomical constraints and hardware manufacturing limitations, WCE vision signals may suffer from insufficient illumination, leading to a complicated screening and examination procedure. Deep learning-based low-light image enhancement (LLIE) in the medical field gradually attracts researchers. Given the exuberant development of the denoising diffusion probabilistic model (DDPM) in computer vision, we introduce a WCE LLIE framework based on the multi-scale convolutional neural network (CNN) and reverse diffusion process. The multi-scale design allows models to preserve high-resolution representation and context information from low-resolution, while the curved wavelet attention (CWA) block is proposed for high-frequency and local feature learning. Furthermore, we combine the reverse diffusion procedure to further optimize the shallow output and generate the most realistic image. The proposed method is compared with ten state-of-the-art (SOTA) LLIE methods and significantly outperforms quantitatively and qualitatively. The superior performance on GI disease segmentation further demonstrates the clinical potential of our proposed model. Our code is publicly accessible.

Image and Video Processing,Computer Vision and Pattern Recognition,Robotics
Gastrointestinal diagnosis using non-white light imaging capsule endoscopy

Gerard Cummins,Benjamin F. Cox,Gastone Ciuti,Thineskrishna Anbarasan,Marc P. Y. Desmulliez,Sandy Cochran,Robert Steele,John N. Plevris,Anastasios Koulaouzidis

DOI: https://doi.org/10.1038/s41575-019-0140-z

2019-04-15

Abstract:Capsule endoscopy (CE) has proved to be a powerful tool in the diagnosis and management of small bowel disorders since its introduction in 2001. However, white light imaging (WLI) is the principal technology used in clinical CE at present, and therefore, CE is limited to mucosal inspection, with diagnosis remaining reliant on visible manifestations of disease. The introduction of WLI CE has motivated a wide range of research to improve its diagnostic capabilities through integration with other sensing modalities. These developments have the potential to overcome the limitations of WLI through enhanced detection of subtle mucosal microlesions and submucosal and/or transmural pathology, providing novel diagnostic avenues. Other research aims to utilize a range of sensors to measure physiological parameters or to discover new biomarkers to improve the sensitivity, specificity and thus the clinical utility of CE. This multidisciplinary Review summarizes research into non-WLI CE devices by organizing them into a taxonomic structure on the basis of their sensing modality. The potential of these capsules to realize clinically useful virtual biopsy and computer-aided diagnosis (CADx) is also reported.

gastroenterology & hepatology
Single-Image-Based 3D Reconstruction of Endoscopic Images

Bilal Ahmad,Pål Anders Floor,Ivar Farup,Casper Find Andersen

DOI: https://doi.org/10.3390/jimaging10040082

2024-03-28

Journal of Imaging

Abstract:A wireless capsule endoscope (WCE) is a medical device designed for the examination of the human gastrointestinal (GI) tract. Three-dimensional models based on WCE images can assist in diagnostics by effectively detecting pathology. These 3D models provide gastroenterologists with improved visualization, particularly in areas of specific interest. However, the constraints of WCE, such as lack of controllability, and requiring expensive equipment for operation, which is often unavailable, pose significant challenges when it comes to conducting comprehensive experiments aimed at evaluating the quality of 3D reconstruction from WCE images. In this paper, we employ a single-image-based 3D reconstruction method on an artificial colon captured with an endoscope that behaves like WCE. The shape from shading (SFS) algorithm can reconstruct the 3D shape using a single image. Therefore, it has been employed to reconstruct the 3D shapes of the colon images. The camera of the endoscope has also been subjected to comprehensive geometric and radiometric calibration. Experiments are conducted on well-defined primitive objects to assess the method’s robustness and accuracy. This evaluation involves comparing the reconstructed 3D shapes of primitives with ground truth data, quantified through measurements of root-mean-square error and maximum error. Afterward, the same methodology is applied to recover the geometry of the colon. The results demonstrate that our approach is capable of reconstructing the geometry of the colon captured with a camera with an unknown imaging pipeline and significant noise in the images. The same procedure is applied on WCE images for the purpose of 3D reconstruction. Preliminary results are subsequently generated to illustrate the applicability of our method for reconstructing 3D models from WCE images.
Feature Pyramid Network Based Spatial Attention and Cross‐Level Semantic Similarity for Diseases Segmentation From Capsule Endoscopy Images

Said Charfi,Mohamed EL Ansari,Lahcen Koutti,Ilyas ELjaafari,Ayoub ELLahyani

DOI: https://doi.org/10.1002/ima.23194

IF: 2.177

2024-10-09

International Journal of Imaging Systems and Technology

Abstract:ABSTRACT As an emerging technology that uses a pill‐sized camera to visualize images of the digestive tract. Wireless capsule endoscopy (WCE) presents several advantages, since it is far less invasive, does not need sedation and has less possible complications compared to standard endoscopy. Hence, it might be exploited as alternative to the standard procedure. WCE is used to diagnosis a variety of gastro‐intestinal diseases such as polyps, ulcers, crohns disease, and hemorrhages. Nevertheless, WCE videos produced after a test may consist of thousands of frames per patient that must be viewed by medical specialists, besides, the capsule free mobility and technological limits cause production of a low quality images. Hence, development of an automatic tool based on artificial intelligence might be very helpful. Moreover, most state‐of‐the‐art works aim at images classification (normal/abnormal) while ignoring diseases segmentation. Therefore, in this work a novel method based on Feature Pyramid Network model is presented. This approach aims at diseases segmentation from WCE images. In this model, modules to optimize and combine features were employed. Specifically, semantic and spatial features were mutually compensated by spatial attention and cross‐level global feature fusion modules. The proposed method testing F1‐score and mean intersection over union are 94.149% and 89.414%, respectively, in the MICCAI 2017 dataset. In the KID Atlas dataset, the method achieved a testing F1‐score and mean intersection over union of 94.557% and 90.416%, respectively. Through the performance analysis, the mean intersection over union in the MICCAI 2017 dataset is 20.414%, 18.484%, 11.444%, 8.794% more than existing approaches. Moreover, the proposed scheme surpassed the methods used for comparison by 29.986% and 9.416% in terms of mean intersection over union in KID Atlas dataset. These results indicate that the proposed approach is promising in diseases segmentation from WCE images.

engineering, electrical & electronic,optics,imaging science & photographic technology
Modified residual attention network for abnormalities segmentation and detection in WCE images

Charfi, Said,Ansari, Mohamed El,Ellahyani, Ayoub,Eljaafari, Ilyas

DOI: https://doi.org/10.1007/s00500-023-09576-w

IF: 3.732

2024-01-15

Soft Computing

Abstract:Wireless capsule endoscopy (WCE) is a technology that uses a pill-sized camera to visualize images of the digestive tract. It presents several advantages, since it is far less invasive, does not require sedation and has less potential complications compared to standard endoscopy. Hence, it might be exploited as alternative to the standard procedure. WCE is used to diagnosis a variety of gastro-intestinal diseases such as polyps, ulcers, Crohn's disease and hemorrhages. Nevertheless, WCE videos can contain thousands of images per patient that must be screened by medical specialists, besides, the capsule free mobility and technological limits cause production of a low quality images. In this paper, a Nouvel method based on Dense-UNet deep learning segmentation model is presented. This approach aims at red lesion, ulcer and polyp detection from WCE images. Then, we propose a modified residual attention network for images classification. The proposed methods training and validation accuracies are 97.57% and 92.70%, with training and validation intersection over union and dice coefficients of 75.31%, 71.29%, 83.50% and 80.66%, respectively, in the red lesion dataset. In the polyp dataset, the method achieved a training and validation accuracies of 98.26% and 92.33%, with training and validation intersection over union and dice coefficients of 92.09%, 95.62%, 80.13% and 87.14%, respectively. Besides, the proposed architecture reached an average accuracy of 99.30%, sensitivity, specificity and F1 score of 98.61%, 100% and 99.30%, respectively. These results demonstrate that the proposed approach is satisfactory in polyp and red lesion segmentation and ulcer detection.

computer science, artificial intelligence, interdisciplinary applications
Real‐time small bowel visualization quality assessment in wireless capsule endoscopy images using different lightweight embeddable models

Vahid Sadeghi,Alireza Mehridehnavi,Yasaman Sanahmadi,Sajed Rakhshani,Mina Omrani,Mohsen Sharifi

DOI: https://doi.org/10.1002/ima.23069

IF: 2.177

2024-03-31

International Journal of Imaging Systems and Technology

Abstract:Abstract Wireless capsule endoscopy (WCE) captures huge number of images, but only a fraction are medically relevant. We propose automated real‐time small bowel visualization quality (SBVQ) assessment to eliminate transmission of irrelevant frames. Our aim is to design lightweight color‐based models for segmenting clean and contaminated regions with minimal parameters, short training, and fast inference, suitable for WCE hardware integration. Using the Kvasir Capsule endoscopy dataset, we constructed models based on distinctive color patterns of clean and contaminated regions. While different classifiers have been trained and evaluated, the k‐nearest neighbors (KNNs), multilayer perceptron (MLP), and gradient‐boosted machine (GBM) obtained superior performance (accuracy: 0.87±0.12, Dice similarity score (DSC): 0.87±0.15, intersection over union (IOU): 0.80±0.19). Logistic regression (LR) had the shortest training and inference times. Our models offer simplicity, compactness, and robustness, delivering satisfactory real‐time performance. Evaluation on the SEE‐AI project dataset confirms good generalization capabilities, demonstrating practical solutions for WCE image analysis.

engineering, electrical & electronic,optics,imaging science & photographic technology
Wireless Capsule Endoscopy Image Classification Based on Vector Sparse Coding

Tao Ma,Yuexian Zou,Zhiqiang Xiang,Lei Li,Yi Li

DOI: https://doi.org/10.1109/chinasip.2014.6889310

2014-01-01

Abstract:Wireless capsule endoscopy (WCE) is a promising technology for gastrointestinal disease detection. Since there are more than 50,000 frames in one WCE video of a patient, classifying the whole frame set of the digestive tract into subsets corresponding to esophagus, stomach, small intestine, and colon is necessary, which can help physicians review and diagnose rapidly and accurately. The digestive organ classification in WCE is a challenging task due to the difficulties in feature representation of WCE images. This paper presents a new method of WCE organ classification by incorporating a proposed locality constraint based vector sparse coding (LCVSC) algorithm with the support vector machine classifier. Experimental results validate the effectiveness of the proposed method and it is encouraging to see that a good classification performance is achieved.
Infinite Curriculum Learning for Efficiently Detecting Gastric Ulcers in WCE Images

Xiaolu Zhang,Shiwan Zhao,Lingxi Xie

DOI: https://doi.org/10.48550/arXiv.1809.02371

2018-09-07

Computer Vision and Pattern Recognition

Abstract:The Wireless Capsule Endoscopy (WCE) is becoming a popular way of screening gastrointestinal system diseases and cancer. However, the time-consuming process in inspecting WCE data limits its applications and increases the cost of examinations. This paper considers WCE-based gastric ulcer detection, in which the major challenge is to detect the lesions in a local region. We propose an approach named infinite curriculum learning, which generalizes curriculum learning to an infinite sampling space by approximately measuring the difficulty of each patch by its scale. This allows us to adapt our model from local patches to global images gradually, leading to a consistent accuracy gain. Experiments are performed on a large dataset with more than 3 million WCE images. Our approach achieves a binary classification accuracy of 87%, and is able to detect some lesions mis-annotated by the physicians. In a real-world application, our approach can reduce the workload of a physician by 90%-98% in gastric ulcer screening.
Pixel-wise annotation for clear and contaminated regions segmentation in wireless capsule endoscopy images: A multicentre database

Vahid Sadeghi,Yasaman Sanahmadi,Maryam Behdad,Alireza Vard,Mohsen Sharifi,Ahmad Raeisi,Mehdi Nikkhah,Alireza Mehridehnavi

DOI: https://doi.org/10.1016/j.dib.2024.110927

2024-09-10

Abstract:Wireless capsule endoscopy (WCE) is capable of non-invasively visualizing the small intestine, the most complicated segment of the gastrointestinal tract, to detect different types of abnormalities. However, its main drawback is reviewing the vast number of captured images (more than 50,000 frames). The recorded images are only sometimes clear, and different contaminating agents, such as turbid materials and air bubbles, degrade the visualization quality of the WCE images. This condition could cause serious problems such as reducing mucosal view visualization, prolonging recorded video reviewing time, and increasing the risks of missing pathology. On the other hand, accurately quantifying the amount of turbid fluids and bubbles can indicate potential motility malfunction. To assist in developing computer vision-based techniques, we have constructed the first multicentre publicly available clear and contaminated annotated dataset by precisely segmenting 17,593 capsule endoscopy images from three different databases. In contrast to the existing datasets, our dataset has been annotated at the pixel level, discriminating the clear and contaminated regions and subsequently differentiating bubbles and turbid fluids from normal tissue. To create the dataset, we first selected all of the images (2906 frames) in the reduced mucosal view class covering different levels of contamination and randomly selected 12,237 images from the normal class of the copyright-free CC BY 4.0 licensed small bowel capsule endoscopy (SBCE) images from the Kvasir capsule endoscopy database. To mitigate the possible available bias in the mentioned dataset and to increase the sample size, the number of 2077 and 373 images have been stochastically chosen from the SEE-AI project and CECleanliness datasets respectively for the subsequent annotation. Randomly selected images have been annotated with the aid of ImageJ and ITK-SNAP software under the supervision of an expert SBCE reader with extensive experience in gastroenterology and endoscopy. For each image, two binary and tri-colour ground truth (GT) masks have been created in which each pixel has been indexed into two classes (clear and contaminated) and three classes (bubble, turbid fluids, and normal), respectively. To the best of the author's knowledge, there is no implemented clear and contaminated region segmentation on the capsule endoscopy reading software. Curated multicentre dataset can be utilized to implement applicable segmentation algorithms for identification of clear and contaminated regions and discrimination bubbles, as well as turbid fluids from normal tissue in the small intestine. Since the annotated images belong to three different sources, they provide a diverse representation of the clear and contaminated patterns in the WCE images. This diversity is valuable for training the models that are more robust to variations in data characteristics and can generalize well across different subjects and settings. The inclusion of images from three different centres allows for robust cross-validation opportunities, where computer vision-based models can be trained on one centre's annotated images and evaluated on others.
Endoscopic capsule robot-based diagnosis, navigation and localization in the gastrointestinal tract

Mark Hanscom,David R Cave

DOI: https://doi.org/10.3389/frobt.2022.896028

2022-09-02

Abstract:The proliferation of video capsule endoscopy (VCE) would not have been possible without continued technological improvements in imaging and locomotion. Advancements in imaging include both software and hardware improvements but perhaps the greatest software advancement in imaging comes in the form of artificial intelligence (AI). Current research into AI in VCE includes the diagnosis of tumors, gastrointestinal bleeding, Crohn's disease, and celiac disease. Other advancements have focused on the improvement of both camera technologies and alternative forms of imaging. Comparatively, advancements in locomotion have just started to approach clinical use and include onboard controlled locomotion, which involves miniaturizing a motor to incorporate into the video capsule, and externally controlled locomotion, which involves using an outside power source to maneuver the capsule itself. Advancements in locomotion hold promise to remove one of the major disadvantages of VCE, namely, its inability to obtain targeted diagnoses. Active capsule control could in turn unlock additional diagnostic and therapeutic potential, such as the ability to obtain targeted tissue biopsies or drug delivery. With both advancements in imaging and locomotion has come a corresponding need to be better able to process generated images and localize the capsule's position within the gastrointestinal tract. Technological advancements in computation performance have led to improvements in image compression and transfer, as well as advancements in sensor detection and alternative methods of capsule localization. Together, these advancements have led to the expansion of VCE across a number of indications, including the evaluation of esophageal and colon pathologies including esophagitis, esophageal varices, Crohn's disease, and polyps after incomplete colonoscopy. Current research has also suggested a role for VCE in acute gastrointestinal bleeding throughout the gastrointestinal tract, as well as in urgent settings such as the emergency department, and in resource-constrained settings, such as during the COVID-19 pandemic. VCE has solidified its role in the evaluation of small bowel bleeding and earned an important place in the practicing gastroenterologist's armamentarium. In the next few decades, further improvements in imaging and locomotion promise to open up even more clinical roles for the video capsule as a tool for non-invasive diagnosis of lumenal gastrointestinal pathologies.
Reducing Data Transmission Efficiency in Wireless Capsule Endoscopy through DL-CEndo Framework: Reconstructing Lossy Low-Resolution Luma Images and Improving Summarization

Abderrahmane Salmi,Wei Zhang,Feng Jiang

DOI: https://doi.org/10.1007/s11036-024-02334-8

2024-05-23

Mobile Networks and Applications

Abstract:Wireless Capsule Endoscopy (WCE) is the preferred technology for the diagnosis and evaluation of small bowel disorders. The concluding WCE video comprises as many as 150,000 images. Within this extensive collection of images, the majority are classified as normal , with only a singular or a few frames identified as pathological. The transmission of such a substantial volume of data from the WCE is constrained by the device's limited battery capacity. The primary objective of this study is to minimize the computational load by shifting the maximum of computations at the decoder side while reducing the information transmitted from the encoder. This paper presents three primary contributions. First, a new Capsule Endoscopy framework leveraging Deep Learning (DL-CEndo) is proposed for the WCE compression system. This framework aims to significantly decrease the transmission of unnecessary data by sending Low-Resolution (LR) luma images, thereby conserving energy in the WCE device. Second, a new colorization model named EndoColorGAN diffusion-based is implemented to reconstruct the colors of unnecessary WCE images. Lastly, the paper introduces a demo for fast and smart summarization, easing the review process for physicians by focusing on essential images within the WCE video. The DL-CEndo framework achieved a high compression ratio of 93.20% with a reconstruction NiQE value of 4.63 and ensures fast diagnostics for physicians. Our demo is available at https://capsule-colorization-framework.vercel.app/.

computer science, information systems,telecommunications, hardware & architecture
Deep learning for registration of region of interest in consecutive wireless capsule endoscopy frames

Chao Liao,Chengliang Wang,Jianying Bai,Libin Lan,Xing Wu

DOI: https://doi.org/10.1016/j.cmpb.2021.106189

Abstract:Background and objective: Functional gastrointestinal disorders (FGIDs) are reported as worldwide gastrointestinal (GI) diseases. GI motility assessment can assist the diagnosis of patients with intestine motility dysfunction. Wireless capsule endoscopy (WCE) can acquire images in the gastrointestinal (GI) tract including the small intestine where other conventional endoscopes cannot penetrate, and WCE images can reveal GI motility. To generally analyze WCE frames, the high-precision registration of consecutive WCE frames is an absolute necessity. It is difficult and meaningless to register entire WCE frames on a pixel level due to the unpredictable and massive non-rigid deformation between consecutive frames, the low quality of imaging and the complex intestinal environment. Thus, the registration of region of interest (ROI) functioning in a feature level has more significance than entire frame registration. Methods: In this paper we present Timecylce-WCE, an end-to-end automatic registration approach of ROIs on WCE images. The clinicians can determine a ROI by drawing a bounding box in any WCE frame to be registered. This proposed approach is based on a deep-learning model of time-consistency in recurrent-registering, skip-registering and self-registering cycle, and it is fully unsupervised without any label. We incorporate the global correlation map with the local correlation map in matching the features, and a novel overall loss function is designed to enable the convergence of the model. As the output, a thin-plate spline (TPS) transformed region in the template frame is highly aligned with the query ROI in a finer-grained level. To the best of our knowledge this is the first time that a deep-learning-based registration method is proposed for WCE imaging motion. Results: To highlight the effectiveness of the proposed approach, our proposed method is compared with the existing non-deep-learning methods and tested in a validation dataset with labeled matching points. The presented method resulted in the best PCK@10 (Percentage of Correct Key-points, i.e., the predicted and the true joint is within the threshold - 10 pixels) of 66.49%. We also demonstrate that variants of design improved registration accuracy. Conclusions: From the experimental analysis, it is clear that our proposed method outperforms the other existing methods. This lays the groundwork for subsequent studies, such as GI motility assessment, and WCE image synthesis.

Applying the transtheoretical model to a representative sample of smokers.

Evaluating clinical diversity and plausibility of synthetic capsule endoscopic images

Clinical Evaluation of Medical Image Synthesis: A Case Study in Wireless Capsule Endoscopy

This Intestine Does Not Exist: Multiscale Residual Variational Autoencoder for Realistic Wireless Capsule Endoscopy Image Generation

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Color-Transfer-Enhanced Data Construction and Validation for Deep Learning-Based Upper Gastrointestinal Landmark Classification in Wireless Capsule Endoscopy

Semantic Map Guided Synthesis of Wireless Capsule Endoscopy Images using Diffusion Models

Capsule Endoscopy Image Classification with Deep Convolutional Neural Networks

Deep Learning-Based Real-Time Organ Localization and Transit Time Estimation in Wireless Capsule Endoscopy

LLCaps: Learning to Illuminate Low-Light Capsule Endoscopy with Curved Wavelet Attention and Reverse Diffusion

Gastrointestinal diagnosis using non-white light imaging capsule endoscopy

Single-Image-Based 3D Reconstruction of Endoscopic Images

Feature Pyramid Network Based Spatial Attention and Cross‐Level Semantic Similarity for Diseases Segmentation From Capsule Endoscopy Images

Modified residual attention network for abnormalities segmentation and detection in WCE images

Real‐time small bowel visualization quality assessment in wireless capsule endoscopy images using different lightweight embeddable models

Wireless Capsule Endoscopy Image Classification Based on Vector Sparse Coding

Infinite Curriculum Learning for Efficiently Detecting Gastric Ulcers in WCE Images

Pixel-wise annotation for clear and contaminated regions segmentation in wireless capsule endoscopy images: A multicentre database

Endoscopic capsule robot-based diagnosis, navigation and localization in the gastrointestinal tract

Reducing Data Transmission Efficiency in Wireless Capsule Endoscopy through DL-CEndo Framework: Reconstructing Lossy Low-Resolution Luma Images and Improving Summarization

Deep learning for registration of region of interest in consecutive wireless capsule endoscopy frames