Abstract:ABSTRACTInfrastructure-assisted autonomous driving is an emerging paradigm that aims to make affordable autonomous vehicles a reality. A key technology for realizing this vision is real-time point cloud registration which allows a vehicle to fuse the 3D point clouds generated by its own LiDAR and those on roadside infrastructures such as smart lampposts, which can deliver increased sensing range, more robust object detection, and centimeter-level navigation. Unfortunately, the existing methods for point cloud registration assume two clouds to share a similar perspective and large overlap, which result in significant delay and inaccuracy in real-world infrastructure-assisted driving settings. This paper proposes VI-Eye - the first system that can align vehicle-infrastructure point clouds at centimeter accuracy in real-time. Our key idea is to exploit traffic domain knowledge by detecting a set of key semantic objects including road, lane lines, curbs, and traffic signs. Based on the inherent regular geometries of such semantic objects, VI-Eye extracts a small number of saliency points and leverage them to achieve real-time registration of two point clouds. By allowing vehicles and infrastructures to extract the semantic information in parallel, VI-Eye leads to a highly scalable architecture for infrastructure-assisted autonomous driving. To evaluate the performance of VI-Eye, we collect two new multiview LiDAR point cloud datasets on an indoor autonomous driving testbed and a campus smart lamppost testbed, respectively. They contain total 915 point cloud pairs and cover three roads of 1.12km. Experiment results show that VI-Eye achieves centimeter-level accuracy within around 0.2s, and delivers a 5X improvement in accuracy and 2X speedup over state-of-the-art baselines.

Cross-Modal Registration Using Adaptive Modeling in Infrastructure-based Vehicle Localization*

Persistent Stereo Visual Localization on Cross-Modal Invariant Map

Multimodal Localization: Stereo over LiDAR Map

VI-eye: semantic-based 3D point cloud registration for infrastructure-assisted autonomous driving

Infrastructure-Based Vehicle Localization System for Indoor Parking Lots Using RGB-D Cameras

Coarse-to-fine heterogeneous point clouds registration in vehicle-to-infrastructure collaboration

Cross-Modal Monocular Localization in Prior LiDAR Maps Utilizing Semantic Consistency.

HPCR-VI: Heterogeneous Point Cloud Registration for Vehicle-Infrastructure Collaboration.

C2L-PR: Cross-modal Camera-to-LiDAR Place Recognition Via Modality Alignment and Orientation Voting

EEPNet: Efficient Edge Pixel-based Matching Network for Cross-Modal Dynamic Registration between LiDAR and Camera

Registration-based moving vehicle detection for low-altitude urban traffic surveillance

Multi-level Height Maps-Based Registration Method for Sparse LiDAR Point Clouds in an Urban Scene

Traffic Sign Based Point Cloud Data Registration with Roadside LiDARs in Complex Traffic Environments

Multi-modal Sensor Registration for Vehicle Perception via Deep Neural Networks

Roadside LiDAR Assisted Cooperative Localization for Connected Autonomous Vehicles

Accurate Cooperative Localization Utilizing LiDAR-equipped Roadside Infrastructure for Autonomous Driving

A Fast Registration Method for MEMS LiDAR Point Cloud Based on Self-Adaptive Segmentation

A Speedy Point Cloud Registration Method Based on Region Feature Extraction in Intelligent Driving Scene

A Lightweight Feature Map Creation Method for Intelligent Vehicle Localization in Urban Road Environments

2D-3D Cross-Modality Network for End-to-End Localization with Probabilistic Supervision

HybridFusion: LiDAR and Vision Cross-Source Point Cloud Fusion