Abstract:In this article, we tackle the problem of depth estimation from single monocular images. Compared with depth estimation using multiple images such as stereo depth perception, depth from monocular images is much more challenging. Prior work typically focuses on exploiting geometric priors or additional sources of information, most using hand-crafted features. Recently, there is mounting evidence that features from deep convolutional neural networks (CNN) set new records for various vision applications. On the other hand, considering the continuous characteristic of the depth values, depth estimation can be naturally formulated as a continuous conditional random field (CRF) learning problem. Therefore, here we present a deep convolutional neural field model for estimating depths from single monocular images, aiming to jointly explore the capacity of deep CNN and continuous CRF. In particular, we propose a deep structured learning scheme which learns the unary and pairwise potentials of continuous CRF in a unified deep CNN framework. We then further propose an equally effective model based on fully convolutional networks and a novel superpixel pooling method, which is about 10 times faster, to speedup the patch-wise convolutions in the deep model. With this more efficient model, we are able to design deeper networks to pursue better performance. Our proposed method can be used for depth estimation of general scenes with no geometric priors nor any extra information injected. In our case, the integral of the partition function can be calculated in a closed form such that we can exactly solve the log-likelihood maximization. Moreover, solving the inference problem for predicting depths of a test image is highly efficient as closed-form solutions exist. Experiments on both indoor and outdoor scene datasets demonstrate that the proposed method outperforms state-of-the-art depth estimation approaches.

Fast Depth Estimation from Single Image Using Structured Forest.

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

A Robust Monocular Depth Estimation Framework Based on Light-Weight ERF-Pspnet for Day-Night Driving Scenes

CRF-Based Reconstruction from Narrow-Baseline Image Sequences.

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

FastDepth: Fast Monocular Depth Estimation on Embedded Systems

Real-Time Head Pose Estimation and Face Modeling from a Depth Image

Depth Estimation from Multi-Scale SLIC Superpixels Using Non-Parametric Learning

Depth estimation for outdoor image using couple dictionary learning and region detection

Search-Based Depth Estimation Via Coupled Dictionary Learning With Large-Margin Structure Inference

Estimating Depth from RGB and Sparse Sensing

Size-to-depth: A New Perspective for Single Image Depth Estimation

FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scene

RGB-Depth Structure Similarity for Self-supervised Monocular Depth Estimation

Single Image Depth Estimation Trained via Depth from Defocus Cues

Depth Information Calculation Method for Unstructured Objects Based on Deep Neural Network

Depth Reconstruction with Neural Signed Distance Fields in Structured Light Systems

RADepthNet: Reflectance-Aware Monocular Depth Estimation

Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields

Unveiling the Depths: A Multi-Modal Fusion Framework for Challenging Scenarios