Abstract:Directly benefited from deep learning techniques, depth estimation from single image has gained great momentum in recent years. However, most of the existing approaches treat depth prediction as an isolated problem without taking into consideration high-level semantic context information, which results in inefficient utilization of training dataset and unavoidably requires a large number of captured depth data during the training phase. To ameliorate, this paper develops a novel scene-aware contextualized convolution neural network (CCNN), which characterizes the semantic context relationship at the class-level and refines depth at the pixel-level. Our newly-proposed CCNN is built upon the intrinsic exploitation of context-dependent depth association, including inner-object continuous depth and inter-object depth change priors nearby. Specifically, rather than conducting regression on depth in single CNN, we make the first attempt to integrate both class-level and pixel-level conditional random fields (CRFs) based probabilistic graphical model into the powerful CNN framework to simultaneously learn different-level features within the same CNN layer. With our CCNN, the former model will guide the latter one to learn the contextualized RGB-Depth mapping. Hence, CCNN has desirable properties in both class-level integrity and pixel-level discrimination, which makes it ideal to share such two-level convolutional features in parallel during the end-to-end training with the commonly-used back-propagation algorithm. We conduct extensive experiments and comprehensive evaluations on public benchmarks involving various indoor and outdoor scenes, and all the experiments confirm that, our method outperforms the state-of-the-art depth estimation methods, especially for the cases where only small-scale training data are readily available.

Object Detection and Depth Estimation Approach Based on Deep Convolutional Neural Networks

Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches.

Monocular Depth Estimation Based on Multi-Scale Graph Convolution Networks

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

A Cnn-Based Depth Estimation Approach With Multi-Scale Sub-Pixel Convolutions And A Smoothness Constraint

Monocular image depth estimation using dilated convolution and spatial pyramid polling structure

Depth-Enhancement Network for Monocular 3D object detection

Object Detection Based on Binocular Vision with Convolutional Neural Network

Monocular Depth Estimation With Affinity, Vertical Pooling, And Label Enhancement

A Self-Supervised Monocular Depth Estimation Method Based on High Resolution Convolutional Neural Network

Object Detection with Depth Information in Road Scenes

Monocular Depth Estimation Based on Dilated Convolutions and Feature Fusion

An Improved Convolutional Neural Network for Monocular Depth Estimation

Depth Dynamic Center Difference Convolutions for Monocular 3D Object Detection.

Boosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervision

Monocular Indoor Depth Estimation Method Based on Neural Networks with Constraints on Two-Dimensional Images and Three-Dimensional Geometry

Deep Multi-scale Convolutional Neural Network Method for Depth Estimation from a Single Image

An Algorithm on Monocular 3D Object Detection Based on Depth Estimation

Learning Depth-Guided Convolutions for Monocular 3D Object Detection

Contextualized CNN for Scene-Aware Depth Estimation from Single RGB Image

Estimating Depth from Monocular Images as Classification Using Deep Fully Convolutional Residual Networks