Abstract:Aiming at facilitating a real-world, ever-evolving and scalable autonomous driving system, we present a large-scale dataset for standardizing the evaluation of different self-supervised and semi-supervised approaches by learning from raw data, which is the first and largest dataset to date. Existing autonomous driving systems heavily rely on `perfect' visual perception models (i.e., detection) trained using extensive annotated data to ensure safety. However, it is unrealistic to elaborately label instances of all scenarios and circumstances (i.e., night, extreme weather, cities) when deploying a robust autonomous driving system. Motivated by recent advances of self-supervised and semi-supervised learning, a promising direction is to learn a robust detection model by collaboratively exploiting large-scale unlabeled data and few labeled data. Existing datasets either provide only a small amount of data or covers limited domains with full annotation, hindering the exploration of large-scale pre-trained models. Here, we release a Large-Scale 2D Self/semi-supervised Object Detection dataset for Autonomous driving, named as SODA10M, containing 10 million unlabeled images and 20K images labeled with 6 representative object categories. To improve diversity, the images are collected within 27833 driving hours under different weather conditions, periods and location scenes of 32 different cities. We provide extensive experiments and deep analyses of existing popular self/semi-supervised approaches, and give some interesting findings in autonomous driving scope. Experiments show that SODA10M can serve as a promising pre-training dataset for different self-supervised learning methods, which gives superior performance when fine-tuning with different downstream tasks (i.e., detection, semantic/instance segmentation) in autonomous driving domain. More information can refer to https://soda-2d.github.io.

SDAC: A Multimodal Synthetic Dataset for Anomaly and Corner Case Detection in Autonomous Driving

Perception Datasets for Anomaly Detection in Autonomous Driving: A Survey

ACDC: The Adverse Conditions Dataset with Correspondences for Semantic Driving Scene Understanding

A synthetic digital city dataset for robustness and generalisation of depth estimation models

Scene Semantic Anomaly Detection of Multi-Sensor in Autonomous Driving

ACDC: The Adverse Conditions Dataset with Correspondences for Robust Semantic Driving Scene Perception

SODA10M: A Large-Scale 2D Self/Semi-Supervised Object Detection Dataset for Autonomous Driving

LiDAR-CS Dataset: LiDAR Point Cloud Dataset with Cross-Sensors for 3D Object Detection

SDM-Car: A Dataset for Small and Dim Moving Vehicles Detection in Satellite Videos

Driver Anomaly Detection: A Dataset and Contrastive Learning Approach

UMAD: Unsupervised Mask-Level Anomaly Detection for Autonomous Driving

OpenAD: Open-World Autonomous Driving Benchmark for 3D Object Detection

What Matters in Autonomous Driving Anomaly Detection: A Weakly Supervised Horizon

Latency-aware Road Anomaly Segmentation in Videos: A Photorealistic Dataset and New Metrics

OpenMPD: An Open Multimodal Perception Dataset for Autonomous Driving

PandaSet: Advanced Sensor Suite Dataset for Autonomous Driving

Progressive Temporal-Spatial-Semantic Analysis of Driving Anomaly Detection and Recounting

AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Driving

Advancing Video Anomaly Detection: A Concise Review and a New Dataset

Multimodal-Enhanced Objectness Learner for Corner Case Detection in Autonomous Driving