Abstract:Vehicle-to-Everything (V2X) network has enabled collaborative perception in autonomous driving, which is a promising solution to the fundamental defect of stand-alone intelligence including blind zones and long-range perception. However, the lack of datasets has severely blocked the development of collaborative perception algorithms. In this work, we release DOLPHINS: Dataset for cOllaborative Perception enabled Harmonious and INterconnected Self-driving, as a new simulated large-scale various-scenario multi-view multi-modality autonomous driving dataset, which provides a ground-breaking benchmark platform for interconnected autonomous driving. DOLPHINS outperforms current datasets in six dimensions: temporally-aligned images and point clouds from both vehicles and Road Side Units (RSUs) enabling both Vehicle-to-Vehicle (V2V) and Vehicle-to-Infrastructure (V2I) based collaborative perception; 6 typical scenarios with dynamic weather conditions make the most various interconnected autonomous driving dataset; meticulously selected viewpoints providing full coverage of the key areas and every object; 42376 frames and 292549 objects, as well as the corresponding 3D annotations, geo-positions, and calibrations, compose the largest dataset for collaborative perception; Full-HD images and 64-line LiDARs construct high-resolution data with sufficient details; well-organized APIs and open-source codes ensure the extensibility of DOLPHINS. We also construct a benchmark of 2D detection, 3D detection, and multi-view collaborative perception tasks on DOLPHINS. The experiment results show that the raw-level fusion scheme through V2X communication can help to improve the precision as well as to reduce the necessity of expensive LiDAR equipment on vehicles when RSUs exist, which may accelerate the popularity of interconnected self-driving vehicles. DOLPHINS is now available on <a class="link-external link-https" href="https://dolphins-dataset.net/" rel="external noopener nofollow">this https URL</a>.

SeePerSea: Multi-modal Perception Dataset of In-water Objects for Autonomous Surface Vehicles

An Open-Source Platform For Underwater Image And Video Analytics

WaterScenes: A Multi-Task 4D Radar-Camera Fusion Dataset and Benchmarks for Autonomous Driving on Water Surfaces

A Dataset for Detection and Segmentation of Underwater Marine Debris in Shallow Waters

Semantic Segmentation of Underwater Imagery: Dataset and Benchmark

DOLPHINS: Dataset for Collaborative Perception enabled Harmonious and Interconnected Self-driving

MassMIND: Massachusetts Maritime INfrared Dataset

MODS -- A USV-oriented object detection and obstacle segmentation benchmark

FLSea: Underwater Visual-Inertial and Stereo-Vision Forward-Looking Datasets

MCMOD: the Multi-Category Large-Scale Dataset for Maritime Object Detection

Machine Learning for Shipwreck Segmentation from Side Scan Sonar Imagery: Dataset and Benchmark

Navya3DSeg -- Navya 3D Semantic Segmentation Dataset & split generation for autonomous vehicles

CoPeD-Advancing Multi-Robot Collaborative Perception: A Comprehensive Dataset in Real-World Environments

OpenMPD: An Open Multimodal Perception Dataset for Autonomous Driving

S2S-Sim: A Benchmark Dataset for Ship Cooperative 3D Object Detection

Semi-supervised Visual Tracking of Marine Animals Using Autonomous Underwater Vehicles

Underwater AUV Navigation Dataset in Natural Scenarios

Pohang Canal Dataset: A Multimodal Maritime Dataset for Autonomous Navigation in Restricted Waters

EnvoDat: A Large-Scale Multisensory Dataset for Robotic Spatial Awareness and Semantic Reasoning in Heterogeneous Environments

Marine vessel detection dataset and benchmark for unmanned surface vehicles

Deep Learning for Enhanced Marine Vision: Object Detection in Underwater Environments