Abstract:Robust Simultaneous Localization and Mapping (SLAM) is a crucial enabler for autonomous navigation in natural, unstructured environments such as parks and gardens. However, these environments present unique challenges for SLAM due to frequent seasonal changes, varying light conditions, and dense vegetation. These factors often degrade the performance of visual SLAM algorithms originally developed for structured urban environments. To address this gap, we present ROVER, a comprehensive benchmark dataset tailored for evaluating visual SLAM algorithms under diverse environmental conditions and spatial configurations. We captured the dataset with a robotic platform equipped with monocular, stereo, and RGB-D cameras, as well as inertial sensors. It covers 39 recordings across five outdoor locations, collected through all seasons and various lighting scenarios, i.e., day, dusk, and night with and without external lighting. With this novel dataset, we evaluate several traditional and deep learning-based SLAM methods and study their performance in diverse challenging conditions. The results demonstrate that while stereo-inertial and RGB-D configurations generally perform better under favorable lighting and moderate vegetation, most SLAM systems perform poorly in low-light and high-vegetation scenarios, particularly during summer and autumn. Our analysis highlights the need for improved adaptability in visual SLAM algorithms for outdoor applications, as current systems struggle with dynamic environmental factors affecting scale, feature extraction, and trajectory consistency. This dataset provides a solid foundation for advancing visual SLAM research in real-world, natural environments, fostering the development of more resilient SLAM systems for long-term outdoor localization and mapping. The dataset and the code of the benchmark are available under <a class="link-external link-https" href="https://iis-esslingen.github.io/rover" rel="external noopener nofollow">this https URL</a>.

4Seasons: A Cross-Season Dataset for Multi-Weather SLAM in Autonomous Driving

4Seasons: Benchmarking Visual SLAM and Long-Term Localization for Autonomous Driving in Challenging Conditions

ROVER: A Multi-Season Dataset for Visual SLAM

Ithaca365: Dataset and Driving Perception under Repeated and Challenging Weather Conditions

The ADUULM-360 Dataset -- A Multi-Modal Dataset for Depth Estimation in Adverse Weather

SeasonDepth: Cross-Season Monocular Depth Prediction Dataset and Benchmark under Multiple Environments.

SeasonDepth: Cross-Season Monocular Depth Prediction Dataset

CARLA-Loc: Synthetic SLAM Dataset with Full-stack Sensor Setup in Challenging Weather and Dynamic Environments

Ford Multi-AV Seasonal Dataset

Adver-City: Open-Source Multi-Modal Dataset for Collaborative Perception Under Adverse Weather Conditions

Snail-Radar: A large-scale diverse dataset for the evaluation of 4D-radar-based SLAM systems

PLT-D3: A High-fidelity Dynamic Driving Simulation Dataset for Stereo Depth and Scene Flow

Scalability in Perception for Autonomous Driving: Waymo Open Dataset.

DSEC: A Stereo Event Camera Dataset for Driving Scenarios

ECMD: An Event-Centric Multisensory Driving Dataset for SLAM

NTU4DRadLM: 4D Radar-centric Multi-Modal Dataset for Localization and Mapping

ZUST Campus: A Lightweight and Practical LiDAR SLAM Dataset for Autonomous Driving Scenarios

Canadian Adverse Driving Conditions Dataset

SemanticSpray++: A Multimodal Dataset for Autonomous Driving in Wet Surface Conditions

SubT-MRS Dataset: Pushing SLAM Towards All-weather Environments