Abstract:Single-view depth estimation refers to the ability to derive three-dimensional information per pixel from a single two-dimensional image. Single-view depth estimation is an ill-posed problem because there are multiple depth solutions that explain 3D geometry from a single view. While deep neural networks have been shown to be effective at capturing depth from a single view, the majority of current methodologies are deterministic in nature. Accounting for uncertainty in the predictions can avoid disastrous consequences when applied to fields such as autonomous driving or medical robotics. We have addressed this problem by quantifying the uncertainty of supervised single-view depth for Bayesian deep neural networks. There are scenarios, especially in medicine in the case of endoscopic images, where such annotated data is not available. To alleviate the lack of data, we present a method that improves the transition from synthetic to real domain methods. We introduce an uncertainty-aware teacher-student architecture that is trained in a self-supervised manner, taking into account the teacher uncertainty. Given the vast amount of unannotated data and the challenges associated with capturing annotated depth in medical minimally invasive procedures, we advocate a fully self-supervised approach that only requires RGB images and the geometric and photometric calibration of the endoscope. In endoscopic imaging, the camera and light sources are co-located at a small distance from the target surfaces. This setup indicates that brighter areas of the image are nearer to the camera, while darker areas are further away. Building on this observation, we exploit the fact that for any given albedo and surface orientation, pixel brightness is inversely proportional to the square of the distance. We propose the use of illumination as a strong single-view self-supervisory signal for deep neural networks.

What problem does this paper attempt to address?

The main issues this paper attempts to address are the uncertainty and self-supervised learning problems in monocular image depth estimation. Specifically: 1. **Uncertainty in Monocular Depth Estimation**: - The paper points out that most existing depth estimation methods are deterministic, meaning they always produce the same output for the same input without measuring the uncertainty of the prediction. This uncertainty is crucial in real-world applications, especially in fields like autonomous driving and medical robotics, where incorrect depth estimation can lead to catastrophic consequences. - The authors address this issue by quantifying the uncertainty of Bayesian deep neural networks, thereby improving the reliability and safety of depth estimation. 2. **Lack of Labeled Data**: - In certain application scenarios, particularly in the medical field (such as endoscopic images), obtaining a large amount of labeled depth data is very difficult or impossible. This limits the effectiveness of supervised learning methods. - To this end, the authors propose a self-supervised learning method that improves model performance by leveraging the uncertainty between synthetic and real data. Specifically, a teacher-student architecture is introduced, which can account for the uncertainty of the teacher model when trained on synthetic data. 3. **Using Illumination Information for Self-Supervised Learning**: - In endoscopic imaging, the camera and light source are usually located near the target surface. This setup means that brighter areas in the image are closer to the camera, while darker areas are farther away. - The authors take advantage of this characteristic and propose a new method called LightDepth, which uses changes in illumination intensity as a self-supervised signal to train deep neural networks for monocular depth estimation. In summary, the main contributions of this paper lie in addressing key issues in monocular depth estimation through the quantification of uncertainty, self-supervised learning, and the use of illumination information, particularly in data-scarce application scenarios. These methods not only improve the accuracy of depth estimation but also enhance the reliability and robustness of the model in real-world applications.

Uncertainty and Self-Supervision in Single-View Depth

On the Uncertain Single-View Depths in Colonoscopies

Bayesian Deep Neural Networks for Supervised Learning of Single-View Depth

Uncertainty-Aware Self-Improving Framework for Depth Estimation

LightDepth: Single-View Depth Self-Supervision from Illumination Decline

Self-Supervised Monocular Depth Estimation by Digging into Uncertainty Quantification

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

MonoProb: Self-Supervised Monocular Depth Estimation with Interpretable Uncertainty

Uncertainty Guided Self-Supervised Monocular Depth Estimation Based on Monte Carlo Method

Self-Supervised Monocular Depth Estimation Via Discrete Strategy and Uncertainty

Self-Supervised Learning of Monocular Visual Odometry and Depth with Uncertainty-Aware Scale Consistency

Digging into Uncertainty in Self-supervised Multi-view Stereo

Unsupervised Monocular Depth Estimation Method Based on Uncertainty Analysis and Retinex Algorithm

Self-supervised Monocular Depth Estimation with Uncertainty-aware Feature Enhancement and Depth Fusion

Measuring and Modeling Uncertainty Degree for Monocular Depth Estimation

Multi-view Monocular Depth and Uncertainty Prediction with Deep SfM in Dynamic Environments

Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videos

WS-SfMLearner: Self-supervised Monocular Depth and Ego-motion Estimation on Surgical Videos with Unknown Camera Parameters

Self-Supervised Monocular Depth Estimation for Endoscopic Imaging

On Monocular Depth Estimation and Uncertainty Quantification using Classification Approaches for Regression