Abstract:Monocular 3D object detection plays a pivotal role in autonomous driving, presenting a formidable challenge by requiring the precise localization of 3D objects within a single image, devoid of depth information. Most existing methods in this domain fall short of harnessing the limited information available in monocular 3D detection tasks. They typically provide only a single detection outcome, omitting essential uncertainty analysis and result post-processing during model inference, thus limiting overall model performance. In this paper, we propose a comprehensive framework that maximizes information extraction from monocular images while encompassing diverse depth estimation and incorporating uncertainty analysis. Specifically, we mine additional information intrinsic to the monocular 3D detection task to augment supervision, thereby addressing the information scarcity challenge. Moreover, our framework handles depth estimation by recovering multiple sets of depth values from calculated visual heights. The final depth estimate and 3D confidence are determined through an uncertainty fusion process, effectively reducing inference errors. Furthermore, to address task weight allocation in multi-task training, we present a versatile training strategy tailored to monocular 3D detection. This approach leverages measurement indicators to monitor task progress, adaptively adjusting loss weights for different tasks. Experimental results on the KITTI and Waymo dataset confirm the effectiveness of our approach. The proposed method consistently provides enhanced performance across various difficulty levels compared to the original framework while maintaining real-time efficiency.

Exploiting Simplified Depth Estimation for Stereo-based 2D Object Detection

Leveraging Front and Side Cues for Occlusion Handling in Monocular 3D Object Detection

Depth incorporating with color improves salient object detection

STS: Surround-view Temporal Stereo for Multi-view 3D Detection

Error modelling of depth estimation based on simplified stereo vision for mobile robots

DSGN++: Exploiting Visual-Spatial Relation for Stereo-based 3D Detectors

Depth Calculation and Object Detection Using Stereo Vision with Subpixel Disparity and HOG Feature

Diversity Matters: Fully Exploiting Depth Clues for Reliable Monocular 3D Object Detection.

MonoCD: Monocular 3D Object Detection with Complementary Depths

Densely Constrained Depth Estimator for Monocular 3D Object Detection

Monocular 3D Object Detection with Decoupled Structured Polygon Estimation and Height-Guided Depth Estimation

On the Importance of Stereo for Accurate Depth Estimation: An Efficient Semi-Supervised Deep Neural Network Approach

Du$^2$Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixels

Boosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervision

Depth Estimation by Combining Binocular Stereo and Monocular Structured-Light

Du2Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixels

BEVStereo++: Accurate Depth Estimation in Multi-view 3D Object Detection via Dynamic Temporal Stereo

MonoAux: Fully Exploiting Auxiliary Information and Uncertainty for Monocular 3D Object Detection

Depth Refinement for Improved Stereo Reconstruction

Semi-Supervised Stereo-Based 3D Object Detection Via Cross-View Consensus

Depth Estimation Matters Most: Improving Per-Object Depth Estimation for Monocular 3D Detection and Tracking