Abstract:<p>Predicting depth from a single image is an attractive research topic since it provides one more dimension of information to enable machines to better perceive the world. Recently, deep learning has emerged as an effective approach to monocular depth estimation. As obtaining labeled data is costly, there is a recent trend to move from supervised learning to unsupervised learning to obtain monocular depth. However, most unsupervised learning methods capable of achieving high depth prediction accuracy will require a deep network architecture which will be too heavy and complex to run on embedded devices with limited storage and memory spaces. To address this issue, we propose a new powerful network with a recurrent module to achieve the capability of a deep network while at the same time maintaining an extremely lightweight size for real-time high performance unsupervised monocular depth prediction from video sequences. Besides, a novel efficient upsample block is proposed to fuse the features from the associated encoder layer and recover the spatial size of features with the small number of model parameters. We validate the effectiveness of our approach via extensive experiments on the KITTI dataset. Our new model can run at a speed of about 110 frames per second (fps) on a single GPU, 37 fps on a single CPU, and 2 fps on a Raspberry Pi 3. Moreover, it achieves higher depth accuracy with nearly 33 times fewer model parameters than state-of-the-art models. To the best of our knowledge, this work is the first extremely lightweight neural network trained on monocular video sequences for real-time unsupervised monocular depth estimation, which opens up the possibility of implementing deep learning-based real-time unsupervised monocular depth prediction on low-cost embedded devices.</p>

OptiDepthNet : A Real-time Unsupervised Monocular Depth Estimation Network

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

A Robust Monocular Depth Estimation Framework Based on Light-Weight ERF-Pspnet for Day-Night Driving Scenes

Monocular Depth Estimation Based on Unsupervised Learning

DCU-NET: Self-supervised Monocular Depth Estimation Based on Densely Connected U-shaped Convolutional Neural Networks.

MiniNet: An extremely lightweight convolutional neural network for real-time unsupervised monocular depth estimation

Unsupervised Monocular Depth Estimation with Encoder-decoder Network

FastDepth: Fast Monocular Depth Estimation on Embedded Systems

MBUDepthNet: Real-Time Unsupervised Monocular Depth Estimation Method for Outdoor Scenes

Deep Neural Networks with Attention Mechanism for Monocular Depth Estimation on Embedded Devices

MobileXNet: An Efficient Convolutional Neural Network for Monocular Depth Estimation

Real-time Monocular Depth Estimation on Embedded Systems

A Deep Joint Network for Monocular Depth Estimation Based on Pseudo-Depth Supervision

Ghost-Depth: A Lightweight Encoder-Decoder Network for Monocular Depth Estimation.

LapUNet: a novel approach to monocular depth estimation using dynamic laplacian residual U-shape networks

LW-Net: A Lightweight Network for Monocular Depth Estimation

SAU-Net: Monocular Depth Estimation Combining Multi-Scale Features and Attention Mechanisms

Fully Convolutional Multi-Scale Dense Networks for Monocular Depth Estimation.

Real-Time Monocular Depth Estimation Merging Vision Transformers on Edge Devices for AIoT

LD-Net: A Lightweight Network for Real-Time Self-Supervised Monocular Depth Estimation

Attention-Based Dense Decoding Network for Monocular Depth Estimation