Abstract:To find an economical solution to infer the depth of the surrounding environment of unmanned agricultural vehicles (UAV), a lightweight depth estimation model called MonoDA based on a convolutional neural network is proposed. A series of sequential frames from monocular videos are used to train the model. The model is composed of two subnetworks-the depth estimation subnetwork and the pose estimation subnetwork. The former is a modified version of U-Net that reduces the number of bridges, while the latter takes EfficientNet-B0 as its backbone network to extract the features of sequential frames and predict the pose transformation relations between the frames. The self-supervised strategy is adopted during the training, which means the depth information labels of frames are not needed. Instead, the adjacent frames in the image sequence and the reprojection relation of the pose are used to train the model. Subnetworks' outputs (depth map and pose relation) are used to reconstruct the input frame, then a self-supervised loss between the reconstructed input and the original input is calculated. Finally, the loss is employed to update the parameters of the two subnetworks through the backward pass. Several experiments are conducted to evaluate the model's performance, and the results show that MonoDA has competitive accuracy over the KITTI raw dataset as well as our vineyard dataset. Besides, our method also possessed the advantage of non-sensitivity to color. On the computing platform of our UAV's environment perceptual system NVIDIA JETSON TX2, the model could run at 18.92 FPS. To sum up, our approach provides an economical solution for depth estimation by using monocular cameras, which achieves a good trade-off between accuracy and speed and can be used as a novel auxiliary depth detection paradigm for UAVs.

Customized Training and Application of Monocular Depth Ranging for Assisted Driving

A Robust Monocular Depth Estimation Framework Based on Light-Weight ERF-Pspnet for Day-Night Driving Scenes

Monocular Depth Estimation Based on Unsupervised Learning

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Depth Estimation of Traffic Scenes from Image Sequence Using Deep Learning.

Estimate Depth Information from Monocular Infrared Images Based on Deep Learning

Real-time Multi-view Omnidirectional Depth Estimation System for Robots and Autonomous Driving on Real Scenes

Monocular Based Navigation System for Autonomous Ground Robots Using Multiple Deep Learning Models

Deep-PDANet: Camera-Radar Fusion for Depth Estimation in Autonomous Driving Scenarios

Vision-Based Distance Measurement in Advanced Driving Assistance Systems

RealNet: Combining Optimized Object Detection with Information Fusion Depth Estimation Co-Design Method on IoT

DNA-Depth: A Frequency-Based Day-Night Adaptation for Monocular Depth Estimation

Depth Sensing Beyond LiDAR Range

Research on Self-Supervised Depth Estimation Algorithm of Driving Scene Based on Monocular Vision.

KFPA Monocular Ranging Algorithm Design and Application in Mobile Edge Computing

On Deep Learning Techniques to Boost Monocular Depth Estimation for Autonomous Navigation

Target-based calibration of 3D LiDAR and binocular camera on unmanned vehicles

Lifelong-MonoDepth: Lifelong Learning for Multidomain Monocular Metric Depth Estimation

Monocular Camera-based Complex Obstacle Avoidance via Efficient Deep Reinforcement Learning

Monocular Depth Estimation with Self-Supervised Learning for Vineyard Unmanned Agricultural Vehicle

Self-supervised monocular depth estimation via joint attention and intelligent mask loss