Abstract:Depth information from still 2D images plays an important role in automated driving, driving safety, and robotics. Monocular depth estimation is considered as an ill-posed and inherently ambiguous problem in general, and a tight issue is how to obtain global information efficiently since pure convolutional neural networks (CNNs) merely extract the local information. To end that, some previous works utilized conditional random fields (CRFs) to obtain the global information, but it is notoriously difficult to optimize. In this paper, a novel hybrid neural network is proposed to solve that, and concurrently a dense depth map is predicted from the monocular still image. Specifically: first, the deep residual network is utilized to obtain multi-scale local information and then feature correlation (FCL) blocks are used to correlate these features. Finally, the feature selection attention-based mechanism is adopted to fuse the multi-layer features, and the multi-layer recurrent neural networks (RNNs) are utilized with bidirectional long short-term memory (Bi-LSTM) unit as the output layer. Furthermore, a novel logarithm exponential average error (LEAE) is proposed to overcome over-weighted problem. The multi-scale feature correlation network (MFCN) is evaluated on large-scale KITTI benchmarks (LKT), which is a subset of KITTI raw dataset, and NYU depth v2. The experiments indicate that the proposed unified network outperforms existing methods. This method also updates the state-of-the-art performance on LKT datasets. Importantly, the depth estimation method can be widely used for collision risk assessment and avoidance in driving assistance systems or automated pilot systems to achieve safety in a more economical and convenient way.

Deep Multi-scale Convolutional Neural Network Method for Depth Estimation from a Single Image

Monocular Depth Estimation Based on Multi-Scale Graph Convolution Networks

Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches.

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Monocular image depth estimation using dilated convolution and spatial pyramid polling structure

A Cnn-Based Depth Estimation Approach With Multi-Scale Sub-Pixel Convolutions And A Smoothness Constraint

A Deep Joint Network for Monocular Depth Estimation Based on Pseudo-Depth Supervision

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

Multi-scale Depth Classification Network for Monocular Depth Estimation

Super-Resolution for Monocular Depth Estimation with Multi-Scale Sub-Pixel Convolutions and a Smoothness Constraint.

Monocular Indoor Depth Estimation Method Based on Neural Networks with Constraints on Two-Dimensional Images and Three-Dimensional Geometry

Fully Convolutional Multi-Scale Dense Networks for Monocular Depth Estimation.

Depth Monocular Estimation with Attention-based Encoder-Decoder Network from Single Image

Depth Estimation from Single Monocular Images Using Deep Hybrid Network

From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimation

A Self-Supervised Monocular Depth Estimation Method Based on High Resolution Convolutional Neural Network

MSFNet:Multi-scale features network for monocular depth estimation

Novel Hybrid Neural Network for Dense Depth Estimation Using On-Board Monocular Images

Depth Inference with Convolutional Neural Network.

High Quality Depth Estimation from Monocular Images Based on Depth Prediction and Enhancement Sub-Networks

Attention-Based Dense Decoding Network for Monocular Depth Estimation