Abstract:Recent advances in monocular 3D detection leverage a depth estimation network explicitly as an intermediate stage of the 3D detection network. Depth map approaches yield more accurate depth to objects than other methods thanks to the depth estimation network trained on a large-scale dataset. However, depth map approaches can be limited by the accuracy of the depth map, and sequentially using two separated networks for depth estimation and 3D detection significantly increases computation cost and inference time. In this work, we propose a method to boost the RGB image-based 3D detector by jointly training the detection network with a depth prediction loss analogous to the depth estimation task. In this way, our 3D detection network can be supervised by more depth supervision from raw LiDAR points, which does not require any human annotation cost, to estimate accurate depth without explicitly predicting the depth map. Our novel object-centric depth prediction loss focuses on depth around foreground objects, which is important for 3D object detection, to leverage pixel-wise depth supervision in an object-centric manner. Our depth regression model is further trained to predict the uncertainty of depth to represent the 3D confidence of objects. To effectively train the 3D detector with raw LiDAR points and to enable end-to-end training, we revisit the regression target of 3D objects and design a network architecture. Extensive experiments on KITTI and nuScenes benchmarks show that our method can significantly boost the monocular image-based 3D detector to outperform depth map approaches while maintaining the real-time inference speed.

Binoboost: Boosting Self-Supervised Monocular Depth Prediction with Binocular Guidance.

Monocular Depth Estimation Based on Unsupervised Learning

Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches.

MonoBooster: Semi-Dense Skip Connection with Cross-Level Attention for Boosting Self-Supervised Monocular Depth Estimation

BaseBoostDepth: Exploiting Larger Baselines For Self-supervised Monocular Depth Estimation

Self‐supervised Monocular Depth Estimation Via Asymmetric Convolution Block

Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimation

Self-Supervised Monocular Depth Estimation via Binocular Geometric Correlation Learning

Boosting Monocular Depth Estimation with Sparse Guided Points

Self-Supervised Monocular Depth Estimation with Self-Reference Distillation and Disparity Offset Refinement

HA-Bins: Hierarchical Adaptive Bins for Robust Monocular Depth Estimation across Multiple Datasets

Semi-supervised Image Depth Prediction with Deep Learning and Binocular Algorithms

Self-Supervised Monocular Depth Estimation with Multi-constraints

Boosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervision

Self-Supervised Monocular Depth Estimation Based on High-Order Spatial Interactions

Self-supervised Monocular Depth Estimation with Self-Distillation and Dense Skip Connection

Self-Supervised Learning of Monocular Depth Estimation Based on Progressive Strategy.

SABV-Depth: A Biologically Inspired Deep Learning Network for Monocular Depth Estimation.

BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimation

Digging Into Self-Supervised Monocular Depth Estimation