Abstract:Using depth estimation joint target detection networks to locate targets in the UAV field of view is a novel application in the depth estimation research field. The presence of more depth variations and low-texture regions in the ultra-low altitude oblique photographic images make them trickier to train for an excellent depth estimation network compared to autonomous driving scenarios. This presents a challenge in achieving optimal training. This study investigates the problem of unsupervised monocular depth estimation for ultra-low altitude oblique photography images. It aims to make subsequent advanced vision tasks better benefit from excellent depth estimation results in terms of overcoming complex scenes. The lack of effective back-projection directionality in training using adjacent frames is attributed to the extensive low-textured areas contained in the training data for complex ultra-low altitude oblique photography. We propose a self-supervised scene-aware refinement learning architecture from the perspective of enhancing feature perception to deal with such problems. The architecture consists of a multi-resolution feature fusion depth network and a perceptual refinement network (PRNet), together with a pose network to enhance regional differences in complex environments from a refined feature context perspective to obtain higher quality depth maps. We rethink the problem of depth information recovery and design the edge information aggregation (EIA) module, which is configured in the decoder section to refine the local region depth detail representation. We design several loss terms to constrain the training of the network in order to improve the quality of depth estimation. Our method is compared with six state-of-the-art self-supervised monocular depth estimation methods on three datasets (UAVid 2020, WildUAV, UAV ula). The experimental results demonstrate that our model achieves the best performance in most scenarios. The code and the private dataset (UAV ula) can be publicly available at https://github.com/takisu0916/MRFEDepth .

A Robust Monocular Depth Estimation Framework Based on Light-Weight ERF-Pspnet for Day-Night Driving Scenes

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Monocular Depth Estimation Based on Unsupervised Learning

Self-supervised Monocular Depth Estimation for All Day Images Using Domain Separation

PADENet: an Efficient and Robust Panoramic Monocular Depth Estimation Network for Outdoor Scenes.

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

Depth Estimation of Traffic Scenes from Image Sequence Using Deep Learning.

SRNSD: Structure-Regularized Night-Time Self-Supervised Monocular Depth Estimation for Outdoor Scenes

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

MBUDepthNet: Real-Time Unsupervised Monocular Depth Estimation Method for Outdoor Scenes

E2LNet: An Efficient and Effective Lightweight Network for Panoramic Depth Estimation

A Lightweight Self-Supervised Training Framework for Monocular Depth Estimation

Self-Supervised Monocular Depth Estimation Based on High-Order Spatial Interactions

MobileXNet: An Efficient Convolutional Neural Network for Monocular Depth Estimation

Fast Monocular Depth Estimation via Side Prediction Aggregation with Continuous Spatial Refinement

Scene-aware refinement network for unsupervised monocular depth estimation in ultra-low altitude oblique photography of UAV

Lightweight Monocular Depth Estimation with an Edge Guided Network

Self-Supervised Monocular Depth Estimation in the Dark: Towards Data Distribution Compensation

LAA-Net: A Physical-prior-knowledge Based Network for Robust Nighttime Depth Estimation

Unsupervised Monocular Depth Estimation with Encoder-decoder Network

Edge-Enhanced Dual-Stream Perception Network for Monocular Depth Estimation