Abstract:Depth estimation is an essential component of computer vision applications for environment perception, 3D reconstruction and scene understanding. Among the available methods, self-supervised monocular depth estimation is noteworthy for its cost-effectiveness, ease of installation and data accessibility. However, there are two challenges with current methods. Firstly, the scale factor of self-supervised monocular depth estimation is uncertain, which poses significant difficulties for practical applications. Secondly, the depth prediction accuracy for high-resolution images is still unsatisfactory, resulting in low utilization of computational resources. We propose a novel solution to address these challenges with three specific contributions. Firstly, an interleaved depth network skip-connection structure and a new depth network decoder are proposed to improve the depth prediction accuracy for high-resolution images. Secondly, a data vertical splicing module is suggested as a data enhancement method to obtain more non-vertical features and improve model generalization. Lastly, a scale recovery module is proposed to recover the accurate absolute depth without additional sensors, which solves the issue of uncertainty in the scale factor. The experimental results demonstrate that the proposed framework significantly improves the prediction accuracy of high-resolution images. In particular, the novel network structure and data vertical splicing module contribute significantly to this improvement. Moreover, in a scenario where the camera height is fixed and the ground is flat, the effect of scale recovery module is comparable to that achieved by using ground truth. Overall, the RSANet framework offers a promising solution to solve the existing challenges in self-supervised monocular depth estimation.

Depth Information Calculation Method for Unstructured Objects Based on Deep Neural Network

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Monocular Depth Estimation Based on Unsupervised Learning

A Robust Monocular Depth Estimation Framework Based on Light-Weight ERF-Pspnet for Day-Night Driving Scenes

Depth Estimation of Traffic Scenes from Image Sequence Using Deep Learning.

DeepLiDAR: Deep Surface Normal Guided Depth Prediction for Outdoor Scene from Sparse LiDAR Data and Single Color Image

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

Indoor Scene Classification by Incorporating Predicted Depth Descriptor.

FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scene

Improving Monocular Depth Estimation by Leveraging Structural Awareness and Complementary Datasets

Monocular depth estimation based on deep learning: An overview

SIM-MultiDepth: Self-Supervised Indoor Monocular Multi-Frame Depth Estimation Based on Texture-Aware Masking

Unsupervised Learning of Depth from Monocular Videos Using 3D-2D Corresponding Constraints

DepthFormer: Exploiting Long-range Correlation and Local Information for Accurate Monocular Depth Estimation

Deeper into Self-Supervised Monocular Indoor Depth Estimation

ClueDepth Grasp: Leveraging positional clues of depth for completing depth of transparent objects

DCL-depth: monocular depth estimation network based on iam and depth consistency loss

Deep Depth Estimation from Visual-Inertial SLAM

Resolution-sensitive self-supervised monocular absolute depth estimation

A Two-Stage Masked Autoencoder Based Network for Indoor Depth Completion

Unsupervised High-Resolution Depth Learning from Videos with Dual Networks