Abstract:Monocular 3D object detection plays a pivotal role in autonomous driving, presenting a formidable challenge by requiring the precise localization of 3D objects within a single image, devoid of depth information. Most existing methods in this domain fall short of harnessing the limited information available in monocular 3D detection tasks. They typically provide only a single detection outcome, omitting essential uncertainty analysis and result post-processing during model inference, thus limiting overall model performance. In this paper, we propose a comprehensive framework that maximizes information extraction from monocular images while encompassing diverse depth estimation and incorporating uncertainty analysis. Specifically, we mine additional information intrinsic to the monocular 3D detection task to augment supervision, thereby addressing the information scarcity challenge. Moreover, our framework handles depth estimation by recovering multiple sets of depth values from calculated visual heights. The final depth estimate and 3D confidence are determined through an uncertainty fusion process, effectively reducing inference errors. Furthermore, to address task weight allocation in multi-task training, we present a versatile training strategy tailored to monocular 3D detection. This approach leverages measurement indicators to monitor task progress, adaptively adjusting loss weights for different tasks. Experimental results on the KITTI and Waymo dataset confirm the effectiveness of our approach. The proposed method consistently provides enhanced performance across various difficulty levels compared to the original framework while maintaining real-time efficiency.

Delving into Monocular 3D Vehicle Tracking: a Decoupled Framework and a Dedicated Metric

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Joint Monocular 3D Vehicle Detection and Tracking

Monocular Quasi-Dense 3D Object Tracking

Dynamic Object Tracking for Self-Driving Cars Using Monocular Camera and LIDAR.

T-2 T-1 T Frame Input Image Region Proposals Monocular 3 D Estimation Deep Association Multi-frame Refinement

A Tracking-By-Detection Based 3D Multiple Object Tracking for Autonomous Driving

Tracking 3-D Motion of Dynamic Objects Using Monocular Visual-Inertial Sensing

Delving into Motion-Aware Matching for Monocular 3D Object Tracking

Monocular Visual Object 3D Localization in Road Scenes

Multi-Vehicle Tracking Based on Monocular Camera in Driver View

Monocular 3D object detection via estimation of paired keypoints for autonomous driving

RTM3D: Real-Time Monocular 3D Detection from Object Keypoints for Autonomous Driving

MCTrack: A Unified 3D Multi-Object Tracking Framework for Autonomous Driving

AB3DMOT: A Baseline for 3D Multi-Object Tracking and New Evaluation Metrics

Depth Estimation Matters Most: Improving Per-Object Depth Estimation for Monocular 3D Detection and Tracking

3D Multi-object Tracking in Autonomous Driving: A Survey

Monocular 3D Object Detection: An Extrinsic Parameter Free Approach

MonoAux: Fully Exploiting Auxiliary Information and Uncertainty for Monocular 3D Object Detection

Monocular 3D Detection for Autonomous Vehicles by Cascaded Geometric Constraints and Depurated Using 3D Results

Kinematic 3D Object Detection in Monocular Video