Abstract:Self-supervised monocular depth estimation is a promising research area due to its ability to train models without relying on expensive and difficult-to-obtain ground truth depth labels. In this domain, models often employ Convolutional Neural Networks (CNNs) and Transformers for feature extraction. While CNNs excel at capturing local features, they struggle with global information due to their limited receptive field. On the other hand, Transformers can capture global features but are computationally expensive. To balance performance and computational efficiency, this paper proposes a lightweight self-supervised monocular depth estimation model that integrates CNN and Transformer architectures. The model introduces an Agent Attention mechanism to effectively model global context while significantly reducing computational complexity. Furthermore, spatial and channel restructured convolution techniques are utilized to minimize the computational cost associated with redundant feature extraction in visual tasks. Validation on the KITTI dataset shows that the model reaches an Absolute Relative Error of 0.104 and a Squared Relative Error of 0.757 while maintaining a nearly constant number of parameters. The accuracy improved to 0.889, with computational complexity (FLOPs) reduced to 4.993G, and training time decreased from 15.5 hours to 13.5 hours. The model also demonstrated strong generalization on the Make 3D dataset, with only 3.0M parameters and low computational complexity, indicating its suitability for resource-constrained devices.

Self-Supervised Monocular Depth Estimation with Binary Mask and Lightweight Network

Monocular Depth Estimation Based on Unsupervised Learning

Unsupervised Monocular Depth and Pose Estimation Using Multiple Masks Based on Photometric and Geometric Consistency

Self-supervised monocular depth estimation via joint attention and intelligent mask loss

MDSNet: self-supervised monocular depth estimation for video sequences using self-attention and threshold mask

Self-Supervised Monocular Depth Estimation Via Effective Local Consistency and Multi-scale Attention

Self-Supervised Monocular Depth Estimation with Multi-constraints

Self-Supervised Monocular Depth Estimation Based on High-Order Spatial Interactions

Self-Supervised Monocular Depth Estimation With Self-Perceptual Anomaly Handling

Self-supervised Monocular Depth Estimation with Multi-Scale Structure Similarity Loss

Unsupervised Scale-Consistent Depth Learning from Video

LW-Net: A Lightweight Network for Monocular Depth Estimation

Unsupervised Monocular Estimation of Depth and Visual Odometry uUsing Attention and Depth-Pose Consistency Loss

Self-Supervised Learning of Monocular Depth Estimation Based on Progressive Strategy.

Self‐supervised Monocular Depth Estimation Via Asymmetric Convolution Block

CCDepth: A Lightweight Self-supervised Depth Estimation Network with Enhanced Interpretability

Spatial-Aware Dynamic Lightweight Self-Supervised Monocular Depth Estimation

Self-supervised coarse-to-fine monocular depth estimation using a lightweight attention module

Towards Loss Balance and Consistent Model in Self-supervised Monocular Depth Estimation

Lightweight Self-Supervised Monocular Depth Estimation Through CNN and Transformer Integration

Monocular Depth Estimation Using Self-Supervised Learning with More Effective Geometric Constraints