Abstract:Aerial building depth estimation is a crucial task in 3D digital urban reconstruction and learning-based multi-view stereo (MVS) methods have recently shown promising results in this field. However, these methods are mainly developed by modifying the general learning-based MVS framework for aerial depth estimation, which lack consideration about the intrinsic structures of buildings and result in insufficient accuracy. Therefore, we propose an end-to-end edge aware depth inference network for large-scale aerial building multi-views stereo, called EG-MVSNet , which incorporates the building edge information and jointly estimate the depth map and edge map. Firstly, we propose a novel Edge-Sensitive Network based on the differentiable Dynamic Sobel Kernels to obtain reliable building edge features while eliminating other irrelevant features. We further propose an UNet-like Edge Prediction Branch and a Building Edge-Depth Loss to constrain the model focus primarily on the building edge features. Notably, the pseudo ground truth (GT) edge map for each aerial image is obtained with classical gradient operators which do not require additional annotation. Secondly, to incorporate the edge features into the depth prediction module, we introduce an Inter-volume Adaptive Fusion Module that adaptively incorporates the edge features volume into a standard cost volume and guides the regularization of the cost volume. An Edge Depth Refinement Module is further proposed to performs 2D-guidance refinement and avoid over-smoothed or blurred depth boundaries. Extensive experiments on the WHU dataset and LuoJia-MVS dataset show that our model significantly outperforms state-of-the-art performance by more than 22% mean absolute error (MAE) compared to RED-Net and 57% MAE compared to MVSNet. Additionally, to validate our proposed model, we reconstruct a synthetic aerial building benchmark based on WHU dataset. The results as far as correctness and accuracy exceeded the results of other MVS methods in a between-method comparison by at least 12% in MAE metric. The dataset and code can be available at https://github.com/zs670980918/EG-MVSNet .

Edge-Aware Spatial Propagation Network for Multi-view Depth Estimation

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Depth Generation Network: Estimating Real World Depth From Stereo And Depth Images

Efficient Edge-Preserving Multi-View Stereo Network for Depth Estimation

A Robust Monocular Depth Estimation Framework Based on Light-Weight ERF-Pspnet for Day-Night Driving Scenes

Multi-view Depth Estimation using Epipolar Spatio-Temporal Networks

Depth Cue Enhancement and Guidance Network for RGB-D Salient Object Detection

Edge-Enhanced Dual-Stream Perception Network for Monocular Depth Estimation

LA-Net: Layout-Aware Dense Network for Monocular Depth Estimation.

Guided Depth Map Super-Resolution Using Recumbent Y Network

Lightweight Monocular Depth Estimation with an Edge Guided Network

Edge aware depth inference for large-scale aerial building multi-view stereo

Adaptive Weighted Network With Edge Enhancement Module For Monocular Self-Supervised Depth Estimation

Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation

EPP-MVSNet: Epipolar-assembling based Depth Prediction for Multi-view Stereo

Agspn: Efficient Attention-Gated Spatial Propagation Network for Depth Completion

DELTAS: Depth Estimation by Learning Triangulation And densification of Sparse points

Depth Estimation via Affinity Learned with Convolutional Spatial Propagation Network

MSFNet:Multi-scale features network for monocular depth estimation

Edge-Assisted Epipolar Transformer for Industrial Scene Reconstruction

Non-parametric Depth Distribution Modelling based Depth Inference for Multi-view Stereo