Abstract:Colonoscopy is the choice procedure to diagnose, screening, and treat the colon and rectum cancer, from early detection of small precancerous lesions (polyps), to confirmation of malign masses. However, the high variability of the organ appearance and the complex shape of both the colon wall and structures of interest make this exploration difficult. Learned visuospatial and perceptual abilities mitigate technical limitations in clinical practice by proper estimation of the intestinal depth. This work introduces a novel methodology to estimate colon depth maps in single frames from monocular colonoscopy videos. The generated depth map is inferred from the shading variation of the colon wall with respect to the light source, as learned from a realistic synthetic database. Briefly, a classic convolutional neural network architecture is trained from scratch to estimate the depth map, improving sharp depth estimations in haustral folds and polyps by a custom loss function that minimizes the estimation error in edges and curvatures. The network was trained by a custom synthetic colonoscopy database herein constructed and released, composed of 248400 frames (47 videos), with depth annotations at the level of pixels. This collection comprehends 5 subsets of videos with progressively higher levels of visual complexity. Evaluation of the depth estimation with the synthetic database reached a threshold accuracy of 95.65%, and a mean-RMSE of 0.451cm, while a qualitative assessment with a real database showed consistent depth estimations, visually evaluated by the expert gastroenterologist coauthoring this paper. Finally, the method achieved competitive performance with respect to another state-of-the-art method using a public synthetic database and comparable results in a set of images with other five state-of-the-art methods. Additionally, three-dimensional reconstructions demonstrated useful approximations of the gastrointestinal tract geometry. Code for reproducing the reported results and the dataset are available at https://github.com/Cimalab-unal/ColonDepthEstimation.

Clinical importance of antiplatelet drugs in cardiovascular diseases.

Task-guided Domain Gap Reduction for Monocular Depth Prediction in Endoscopy

Disturbances of sleep by noise

Self-supervised Monocular Depth and Pose Estimation for Endoscopy with Generative Latent Priors

SLAM Endoscopy enhanced by adversarial depth prediction

Self-supervised monocular depth estimation for gastrointestinal endoscopy

Deep Learning and Conditional Random Fields-based Depth Estimation and Topographical Reconstruction from Conventional Endoscopy

EndoDAC: Efficient Adapting Foundation Model for Self-Supervised Depth Estimation from Any Endoscopic Camera

Depth Estimation from Single-shot Monocular Endoscope Image Using Image Domain Adaptation And Edge-Aware Depth Estimation

Depth estimation from monocular endoscopy using simulation and image transfer approach

Advancing Depth Anything Model for Unsupervised Monocular Depth Estimation in Endoscopy

Cross-Domain Conditional Generative Adversarial Networks for Stereoscopic Hyperrealism in Surgical Training

High-fidelity Endoscopic Image Synthesis by Utilizing Depth-guided Neural Surfaces

Self-Supervised Generative Adversarial Network for Depth Estimation in Laparoscopic Images

The effect of food-deprivation and re-feeding on brain enzyme activity in immature rat brain.

ToDER: Towards Colonoscopy Depth Estimation and Reconstruction with Geometry Constraint Adaptation

Learning-Based Depth and Pose Estimation for Monocular Endoscope with Loss Generalization

Self-Supervised Monocular Depth Estimation for Endoscopic Imaging

Generalizing monocular colonoscopy image depth estimation by uncertainty-based global and local fusion network

Conditional Generative Adversarial Network for Monocular Image Depth Map Prediction

Leveraging a realistic synthetic database to learn Shape-from-Shading for estimating the colon depth in colonoscopy images