Abstract:Recovering the three-dimensional structure information from a monocular camera is significant for automated driving, robot navigation, and traffic safety assessment. Recent work has solved various tight issues on self-supervised monocular depth estimation of leveraging on-board videos, such as occlusion/disocclusion, dynamic objects, and scale inconsistent. Nevertheless, rare work focuses on the model’s prediction confidence and underlying relations between depths, while they are essential for a decision-making system and performance improvement, respectively. This paper proposes a novel scheme, that of correlation-aware structure, to dig into the relations between depths, converting the independent depths into a graph-like connected depth map. Subsequently, a Gaussian estimator is devised to predict the depth map and uncertainty map concurrently. The uncertainty map can show us problematic regions where it is difficult to predict, from which we further develop uncertainty-based strategies to improve the performance. Specifically, we propose a simple image preprocessing method to overcome the gradient locality issue caused by low-texture, especially in smooth roads and shadows. Also, to avoid the influence of high-uncertainty regions, we propose a solidity-aware mask to recognize the reliable pixels for training in the image. The experiments on the KITTI dataset show that our method results in a competitive performance in both depth and ego-motion estimation tasks compared with the state-of-the-art methods. Besides, additional experiments on the Make3D and Cityscapes datasets demonstrate our method’s strong generalization capability and practicality.

Joint Monocular 3d Car Shape Estimation And Landmark Localization Via Cascaded Regression

Joint 3-D Shape Estimation and Landmark Localization from Monocular Cameras of Intelligent Vehicles

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

Robust Monocular 3D Car Shape Estimation from 2D Landmarks.

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

3D Shape Estimation from 2D Landmarks: A Convex Relaxation Approach

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

Joint Voxel and Coordinate Regression for Accurate 3D Facial Landmark Localization

Monocular 3D Face Reconstruction with Joint 2D and 3D Constraints

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Geometric and appearance model based approach for head pose recovery in monocular image sequence

On 3D Face Reconstruction via Cascaded Regression in Shape Space

Joint-Confidence-Guided Multi-Task Learning for 3D Reconstruction and Understanding from Monocular Camera

Monocular 3D Detection for Autonomous Vehicles by Cascaded Geometric Constraints and Depurated Using 3D Results

Joint Monocular 3D Vehicle Detection and Tracking

Joint Head Pose and Facial Landmark Regression from Depth Images

Joint Representation of Multiple Geometric Priors via a Shape Decomposition Model for Single Monocular 3D Pose Estimation.

Monocular 3D object detection via estimation of paired keypoints for autonomous driving

Self-Supervised 3D Reconstruction and Ego-Motion Estimation Via On-Board Monocular Video

Coupled Cascade Regression For Simultaneous Facial Landmark Detection And Head Pose Estimation

Joint Optimization of the 3D Model and 6D Pose for Monocular Pose Estimation