Abstract:Depth estimation using monocular vision sensors is crucial in computer vision, with diverse applications ranging from autonomous driving to robot motion. Conventional methods suffer from the trade-off between consistency and fine-grained details due to the local-receptive field limiting their practicality. This lack of long-range dependency inherently comes from the convolutional neural network (CNN) part of the architecture. In this article, a dual window transformer-based network, namely DwinFormer, is proposed, which utilizes both local and global features for depth estimation using monocular vision sensors. The DwinFormer consists of dual window self-attention (Dwin-SA) and cross-attention transformers, dual window self-attention transformer (Dwin-SAT) and dual window cross attention transformer (Dwin-CAT), respectively. The Dwin-SAT seamlessly extracts intricate, locally aware features while concurrently capturing global context. It harnesses the power of local and global window attention to adeptly capture both short-range and long-range dependencies, obviating the need for complex and computationally expensive operations, such as attention masking or window shifting. Moreover, Dwin-SAT introduces inductive biases which provide desirable properties, such as translational equivariance and less dependence on large-scale data. Furthermore, conventional decoding methods often rely on skip connections which may result in semantic discrepancies and a lack of global context when fusing encoder and decoder features. In contrast, the Dwin-CAT employs both local and global window cross-attention to seamlessly fuse encoder and decoder features with both fine-grained local and contextually aware global information, effectively amending semantic gap. Empirical evidence obtained through extensive experimentation on the NYU-Depth-V2 and Karlsruhe Institute of Technology and Toyota Technological Institute (KITTI) datasets demonstrates the superiority of the proposed method, - onsistently outperforming existing approaches across both indoor and outdoor environments.

DwinFormer: Dual Window Transformers for End-to-End Monocular Depth Estimation

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Depthformer : Multiscale Vision Transformer For Monocular Depth Estimation With Local Global Information Fusion

DepthFormer: Exploiting Long-range Correlation and Local Information for Accurate Monocular Depth Estimation

Monocular Depth Estimation Based on Dilated Convolutions and Feature Fusion

PCTDepth: Exploiting Parallel CNNs and Transformer via Dual Attention for Monocular Depth Estimation

TinyDepth: Lightweight Self-Supervised Monocular Depth Estimation Based on Transformer

Edge-Enhanced Dual-Stream Perception Network for Monocular Depth Estimation

Swin-Depth: Using Transformers and Multi-Scale Fusion for Monocular-Based Depth Estimation

Depth-Guided Vision Transformer With Normalizing Flows for Monocular 3D Object Detection

Lightweight Monocular Depth Estimation with an Edge Guided Network

SwinDepth: Unsupervised Depth Estimation using Monocular Sequences via Swin Transformer and Densely Cascaded Network

EDFIDepth: enriched multi-path vision transformer feature interaction networks for monocular depth estimation

A Contour-Aware Monocular Depth Estimation Network using Swin Transformer and Cascaded Multi-scale Fusion

Monocular Depth Estimation Algorithm Integrating Parallel Transformer and Multi-Scale Features

Deep Monocular Depth Estimation Based on Content and Contextual Features

Lightweight Self-Supervised Monocular Depth Estimation Through CNN and Transformer Integration

A Monocular Depth Estimation Method for Indoor-Outdoor Scenes Based on Vision Transformer

MobileXNet: An Efficient Convolutional Neural Network for Monocular Depth Estimation

Self-supervised Monocular Depth Estimation with Large Kernel Attention

Dual-attention-based semantic-aware self-supervised monocular depth estimation