Abstract:Depth estimation is crucial for scene understanding and downstream tasks, especially the self-supervised training methods showing great potential. The overall structure and local details of the scene are essential for improving the quality of depth estimation. The proposal of Monodepth2 has led to significant progress in self-supervised monocular depth estimation. However, Monodepth2 uses the most basic encoder–decoder architecture. The limited data flow information of the network leads to a large semantic gap between the encoder and the decoder, which reduces the accuracy of the network for fine-grained feature recognition. Monodepth2 adopts Resnet18 pre-trained on the Imagenet dataset as the encoder. This traditional convolutional pooling structure results in a loss of pixel information in the network at every scale. In order to solve this problem, this paper proposes an improved DepthNet. The network adopts Hrnet in semantic segmentation as the base encoder, which adopts an advanced multi-scale fusion method in the whole process, thus avoiding the loss of pixel information. An additional densely connected U-Net is employed at the decoder side to provide more information flow. Furthermore, the semantic gap between the encoder and decoder is reduced by adding different numbers of residual connections and channel attention on each layer. The network structure can be regarded as a collection of fully convolutional networks. Since the deep features of the network have a higher correlation with the vertical position, we add a spatial location attention module to the deep-level network to reduce this semantic gap. The approach performs significantly well on the KITTI dataset benchmark, with several performance criteria comparable to supervised monocular depth inference methods.

Self-Supervised Monocular Depth Estimation Based on Channel Attention

Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Monocular Depth Estimation Based on Unsupervised Learning

Unsupervised Monocular Depth Estimation with Channel and Spatial Attention

MonoBooster: Semi-Dense Skip Connection with Cross-Level Attention for Boosting Self-Supervised Monocular Depth Estimation

MDSNet: self-supervised monocular depth estimation for video sequences using self-attention and threshold mask

Self-supervised Monocular Depth Estimation Via Two Mechanisms of Attention-Aware Cost Volume

Self-supervised Monocular Depth Estimation with Coordinate Attention

Attention-Based Monocular Depth Estimation Considering Global and Local Information in Remote Sensing Images

Self-supervised Monocular Depth Estimation Based on Combining Convolution and Multilayer Perceptron

Self-supervised Monocular Depth Estimation with Multi-Scale Structure Similarity Loss

Self-supervised Monocular Depth Estimation with Large Kernel Attention

MFCS-Depth: an Economical Self-Supervised Monocular Depth Estimation Based on Multi-Scale Fusion and Channel Separation Attention

Self-supervised coarse-to-fine monocular depth estimation using a lightweight attention module

Attention-Based Dense Decoding Network for Monocular Depth Estimation

Unsupervised Monocular Depth Estimation Based on Dual Attention Mechanism and Depth-Aware Loss

Unsupervised Monocular Depth Estimation Using Attention and Multi-Warp Reconstruction

Depth Monocular Estimation with Attention-based Encoder-Decoder Network from Single Image

DCU-NET: Self-supervised Monocular Depth Estimation Based on Densely Connected U-shaped Convolutional Neural Networks.

Structure-Attentioned Memory Network for Monocular Depth Estimation