Abstract:Robust Simultaneous Localization and Mapping (SLAM) is a crucial enabler for autonomous navigation in natural, unstructured environments such as parks and gardens. However, these environments present unique challenges for SLAM due to frequent seasonal changes, varying light conditions, and dense vegetation. These factors often degrade the performance of visual SLAM algorithms originally developed for structured urban environments. To address this gap, we present ROVER, a comprehensive benchmark dataset tailored for evaluating visual SLAM algorithms under diverse environmental conditions and spatial configurations. We captured the dataset with a robotic platform equipped with monocular, stereo, and RGB-D cameras, as well as inertial sensors. It covers 39 recordings across five outdoor locations, collected through all seasons and various lighting scenarios, i.e., day, dusk, and night with and without external lighting. With this novel dataset, we evaluate several traditional and deep learning-based SLAM methods and study their performance in diverse challenging conditions. The results demonstrate that while stereo-inertial and RGB-D configurations generally perform better under favorable lighting and moderate vegetation, most SLAM systems perform poorly in low-light and high-vegetation scenarios, particularly during summer and autumn. Our analysis highlights the need for improved adaptability in visual SLAM algorithms for outdoor applications, as current systems struggle with dynamic environmental factors affecting scale, feature extraction, and trajectory consistency. This dataset provides a solid foundation for advancing visual SLAM research in real-world, natural environments, fostering the development of more resilient SLAM systems for long-term outdoor localization and mapping. The dataset and the code of the benchmark are available under <a class="link-external link-https" href="https://iis-esslingen.github.io/rover" rel="external noopener nofollow">this https URL</a>.

STAR-loc: Dataset for STereo And Range-based localization

LocNet: Global Localization in 3D Point Clouds for Mobile Robots.

Persistent Stereo Visual Localization on Cross-Modal Invariant Map

Multimodal Localization: Stereo over LiDAR Map

2-Entity RANSAC for Robust Visual Localization in Changing Environment

The UTIAS multi-robot cooperative localization and mapping dataset

STARSS22: A dataset of spatial recordings of real scenes with spatiotemporal annotations of sound events

UTIL: An ultra-wideband time-difference-of-arrival indoor localization dataset

The LuViRA Dataset: Synchronized Vision, Radio, and Audio Sensors for Indoor Localization

ROVER: A Multi-Season Dataset for Visual SLAM

LocaRDS: A Localization Reference Data Set

UAVD4L: A Large-Scale Dataset for UAV 6-DoF Localization

Addressing Relative Pose Impact on UWB Localization: Dataset Introduction and Analysis

NTU4DRadLM: 4D Radar-centric Multi-Modal Dataset for Localization and Mapping

Snail-Radar: A large-scale diverse dataset for the evaluation of 4D-radar-based SLAM systems

A New Stereo Benchmarking Dataset for Satellite Images

STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events

Stereo and LiDAR Loosely Coupled SLAM Constrained Ground Detection

The Newer College Dataset: Handheld LiDAR, Inertial and Vision with Ground Truth

The Aqualoc Dataset: Towards Real-Time Underwater Localization from a Visual-Inertial-Pressure Acquisition System