Abstract:Monocular 3D object detection plays a pivotal role in autonomous driving, presenting a formidable challenge by requiring the precise localization of 3D objects within a single image, devoid of depth information. Most existing methods in this domain fall short of harnessing the limited information available in monocular 3D detection tasks. They typically provide only a single detection outcome, omitting essential uncertainty analysis and result post-processing during model inference, thus limiting overall model performance. In this paper, we propose a comprehensive framework that maximizes information extraction from monocular images while encompassing diverse depth estimation and incorporating uncertainty analysis. Specifically, we mine additional information intrinsic to the monocular 3D detection task to augment supervision, thereby addressing the information scarcity challenge. Moreover, our framework handles depth estimation by recovering multiple sets of depth values from calculated visual heights. The final depth estimate and 3D confidence are determined through an uncertainty fusion process, effectively reducing inference errors. Furthermore, to address task weight allocation in multi-task training, we present a versatile training strategy tailored to monocular 3D detection. This approach leverages measurement indicators to monitor task progress, adaptively adjusting loss weights for different tasks. Experimental results on the KITTI and Waymo dataset confirm the effectiveness of our approach. The proposed method consistently provides enhanced performance across various difficulty levels compared to the original framework while maintaining real-time efficiency.

Monocular 3D Object Detection for Distant Objects

Leveraging Front and Side Cues for Occlusion Handling in Monocular 3D Object Detection

Monocular 3D object detection via estimation of paired keypoints for autonomous driving

Accurate Monocular 3D Object Detection Via Color-Embedded 3D Reconstruction for Autonomous Driving.

Accurate Monocular Object Detection via Color-Embedded 3D Reconstruction for Autonomous Driving

RTM3D: Real-Time Monocular 3D Detection from Object Keypoints for Autonomous Driving

Monocular 3D Object Detection: An Extrinsic Parameter Free Approach

Monocular 3D object detection using dual quadric for autonomous driving

Monocular 3D Object Detection With Sequential Feature Association and Depth Hint Augmentation

Monocular 3D Object Detection Based on Pseudo-LiDAR Point Cloud for Autonomous Vehicles

Monocular 3D Detection for Autonomous Vehicles by Cascaded Geometric Constraints and Depurated Using 3D Results

Monocular 3-D Vehicle Detection Using a Cascade Network for Autonomous Driving

Shape-Aware Monocular 3D Object Detection

Stereo R-CNN based 3D Object Detection for Autonomous Driving

Keypoint3D: Keypoint-Based and Anchor-Free 3D Object Detection for Autonomous Driving with Monocular Vision

Monocular 3D Object Detection Based on Occlusion Optimization

Monocular 3D Object Detection Based on Pseudo Multimodal Information Extraction and Keypoint Estimation

Pseudo-Mono for Monocular 3D Object Detection in Autonomous Driving

MonoAux: Fully Exploiting Auxiliary Information and Uncertainty for Monocular 3D Object Detection

Monocular 3D Object Detection with Motion Feature Distillation.

Context-Aware 3D Object Detection from a Single Image in Autonomous Driving.