Abstract:Monocular depth estimation is a central problem in computer vision and robot vision, aiming at obtaining the depth information of a scene from a single image. In some extreme environments such as dynamics or drastic lighting changes, monocular depth estimation methods based on conventional cameras often perform poorly. Event cameras are able to capture brightness changes asynchronously but are not able to acquire color and absolute brightness information. Thus, it is an ideal choice to make full use of the complementary advantages of event cameras and conventional cameras. However, how to effectively fuse event data and frames to improve the accuracy and robustness of monocular depth estimation remains an urgent problem. To overcome these challenges, a novel Coordinate Attention Gated Recurrent Unit (CAGRU) is proposed in this paper. Unlike the conventional ConvGRUs, our CAGRU abandons the conventional practice of using convolutional layers for all the gates and innovatively designs the coordinate attention as an attention gate and combines it with the convolutional gate. Coordinate attention explicitly models inter-channel dependencies and coordinate information in space. The coordinate attention gate in conjunction with the convolutional gate enable the network to model feature information spatially, temporally, and internally across channels. Based on this, the CAGRU can enhance the information density of the sparse events in the spatial domain in the recursive process of temporal information, thereby achieving more effective feature screening and fusion. It can effectively integrate feature information from event cameras and standard cameras, further improving the accuracy and robustness of monocular depth estimation. The experimental results show that the method proposed in this paper achieves significant performance improvements on different public datasets.

Event-based Monocular Depth Estimation with Recurrent Transformers

Event-based Monocular Dense Depth Estimation with Recurrent Transformers

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Monocular Depth Estimation Based on Multi-Scale Graph Convolution Networks

Event-based Video Reconstruction Using Transformer

Fusing Events and Frames with Coordinate Attention Gated Recurrent Unit for Monocular Depth Estimation

Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction

Learning Monocular Dense Depth from Events

Combing Transformer and CNN for Monocular Depth Estimation

Monocular Depth Estimation Algorithm Integrating Parallel Transformer and Multi-Scale Features

Self-supervised Event-based Monocular Depth Estimation using Cross-modal Consistency

Depthformer : Multiscale Vision Transformer For Monocular Depth Estimation With Local Global Information Fusion

Lightweight Self-Supervised Monocular Depth Estimation Through CNN and Transformer Integration

Improving Depth Gradient Continuity in Transformers: A Comparative Study on Monocular Depth Estimation with CNN

Lightweight Monocular Depth Estimation with an Edge Guided Network

TinyDepth: Lightweight Self-Supervised Monocular Depth Estimation Based on Transformer

DepthFormer: Exploiting Long-range Correlation and Local Information for Accurate Monocular Depth Estimation

Learning Monocular Depth from Events via Egomotion Compensation

A Novel Spike Transformer Network for Depth Estimation from Event Cameras via Cross-modality Knowledge Distillation

PCTDepth: Exploiting Parallel CNNs and Transformer via Dual Attention for Monocular Depth Estimation

Multi-view Depth Estimation using Epipolar Spatio-Temporal Networks