Abstract:Monocular 3D vehicle localization is an important task in Intelligent Transportation System (ITS) and Cooperative Vehicle Infrastructure System (CVIS), which is usually achieved by monocular 3D vehicle detection. However, depth information cannot be obtained directly by monocular cameras due to the inherent imaging mechanism, resulting in more challenging monocular 3D tasks. Most of the current monocular 3D vehicle detection methods leverage 2D detectors and additional geometric modules, which reduces the efficiency. In this paper, we propose a 3D vehicle localization network CenterLoc3D for roadside monocular cameras, which directly predicts centroid and eight vertexes in image space, and the dimension of 3D bounding boxes without 2D detectors. To improve the precision of 3D vehicle localization, we propose a weighted-fusion module and a loss with spatial constraints embedded in CenterLoc3D. Firstly, the transformation matrix between 2D image space and 3D world space is solved by camera calibration. Secondly, vehicle type, centroid, eight vertexes, and the dimension of 3D vehicle bounding boxes are obtained by CenterLoc3D. Finally, centroid in 3D world space can be obtained by camera calibration and CenterLoc3D for 3D vehicle localization. To the best of our knowledge, this is the first application of 3D vehicle localization for roadside monocular cameras. Hence, we also propose a benchmark for this application including a dataset (SVLD-3D), an annotation tool (LabelImg-3D), and evaluation metrics. Through experimental validation, the proposed method achieves high accuracy and real-time performance. (limited words, please see the article for more details)

Object Detection and Spatial Location Method for Monocular Camera Based on 3D Virtual Geographical Scene

MonoDistill: Learning Spatial Features for Monocular 3D Object Detection

CenterLoc3D: Monocular 3D Vehicle Localization Network for Roadside Surveillance Cameras

Three-dimensional Spatial Localization Based on Binocular Vsion

Monocular 3D Object Detection with Motion Feature Distillation.

Monocular 3D Detection for Autonomous Vehicles by Cascaded Geometric Constraints and Depurated Using 3D Results

Monocular 3D Object Detection Based on Pseudo Multimodal Information Extraction and Keypoint Estimation

Monocular Visual Object 3D Localization in Road Scenes

Monocular 3D Object Detection for Distant Objects

Three-Dimensional Detection Method of Autonomous Driving Platform Based on Roadside Monocular Camera

SGM3D: Stereo Guided Monocular 3D Object Detection

An Algorithm on Monocular 3D Object Detection Based on Depth Estimation

Weakly Supervised Monocular 3D Object Detection by Spatial-Temporal View Consistency

3D Street Object Detection from Monocular Images Using Deep Learning and Depth Information

Survey on Vision-Based 3D Object Detection Methods

Monocular image-oriented three-dimensional object detection method based on three-dimensional reconstruction

Monocular 3D Object Detection: An Extrinsic Parameter Free Approach

Monocular Vehicle 3D Bounding Box Estimation Using Homograhy and Geometry in Traffic Scene

Accurate Monocular 3D Object Detection Via Color-Embedded 3D Reconstruction for Autonomous Driving.

Delving into Localization Errors for Monocular 3D Object Detection

MVM3Det: A Novel Method for Multi-view Monocular 3D Detection