Abstract:Perception systems of autonomous vehicles are susceptible to occlusion, especially when examined from a vehicle-centric perspective. Such occlusion can lead to overlooked object detections, e.g., larger vehicles such as trucks or buses may create blind spots where cyclists or pedestrians could be obscured, accentuating the safety concerns associated with such perception system limitations. To mitigate these challenges, the vehicle-to-everything (V2X) paradigm suggests employing an infrastructure-side perception system (IPS) to complement autonomous vehicles with a broader perceptual scope. Nevertheless, the scarcity of real-world 3D infrastructure-side datasets constrains the advancement of V2X technologies. To bridge these gaps, this paper introduces a new 3D infrastructure-side collaborative perception dataset, abbreviated as inscope. Notably, InScope is the first dataset dedicated to addressing occlusion challenges by strategically deploying multiple-position Light Detection and Ranging (LiDAR) systems on the infrastructure side. Specifically, InScope encapsulates a 20-day capture duration with 303 tracking trajectories and 187,787 3D bounding boxes annotated by experts. Through analysis of benchmarks, four different benchmarks are presented for open traffic scenarios, including collaborative 3D object detection, multisource data fusion, data domain transfer, and 3D multiobject tracking tasks. Additionally, a new metric is designed to quantify the impact of occlusion, facilitating the evaluation of detection degradation ratios among various algorithms. The Experimental findings showcase the enhanced performance of leveraging InScope to assist in detecting and tracking 3D multiobjects in real-world scenarios, particularly in tracking obscured, small, and distant objects. The dataset and benchmarks are available at <a class="link-external link-https" href="https://github.com/xf-zh/InScope" rel="external noopener nofollow">this https URL</a>.

IPS300+: a Challenging Multi-Modal Data Sets for Intersection Perception System

IPS300+: a Challenging Multimodal Dataset for Intersection Perception System

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

OpenMPD: An Open Multimodal Perception Dataset for Autonomous Driving

A9 Intersection Dataset: All You Need for Urban 3D Camera-LiDAR Roadside Perception

HoloVIC: Large-scale Dataset and Benchmark for Multi-Sensor Holographic Intersection and Vehicle-Infrastructure Cooperative

InScope: A New Real-world 3D Infrastructure-side Collaborative Perception Dataset for Open Traffic Scenarios

Intersection Is Also Needed: A Novel LiDAR-Based Road Intersection Dataset and Detection Method

Multi-V2X: A Large Scale Multi-modal Multi-penetration-rate Dataset for Cooperative Perception

MIPD: A Multi-sensory Interactive Perception Dataset for Embodied Intelligent Driving

OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communication

V2I based environment perception for autonomous vehicles at intersections

Occlusion-Aware 2D and 3D Centerline Detection for Urban Driving via Automatic Label Generation

V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perception

CORP: A Multi-Modal Dataset for Campus-Oriented Roadside Perception Tasks

Enhanced Perception for Autonomous Vehicles at Obstructed Intersections: An Implementation of Vehicle to Infrastructure (V2I) Collaboration

Ithaca365: Dataset and Driving Perception under Repeated and Challenging Weather Conditions

The IMPTC Dataset: An Infrastructural Multi-Person Trajectory and Context Dataset

SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Driving

InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensors