Abstract:Visibility underwater is challenging, and degrades as the distance between the subject and camera increases, making vision tasks in the forward-looking direction more difficult. We have collected underwater forward-looking stereo-vision and visual-inertial image sets in the Mediterranean and Red Sea. To our knowledge there are no other public datasets in the underwater environment acquired with this camera-sensor orientation published with ground-truth. These datasets are critical for the development of several underwater applications, including obstacle avoidance, visual odometry, 3D tracking, Simultaneous Localization and Mapping (SLAM) and depth estimation. The stereo datasets include synchronized stereo images in dynamic underwater environments with objects of known-size. The visual-inertial datasets contain monocular images and IMU measurements, aligned with millisecond resolution timestamps and objects of known size which were placed in the scene. Both sensor configurations allow for scale estimation, with the calibrated baseline in the stereo setup and the IMU in the visual-inertial setup. Ground truth depth maps were created offline for both dataset types using photogrammetry. The ground truth is validated with multiple known measurements placed throughout the imaged environment. There are 5 stereo and 8 visual-inertial datasets in total, each containing thousands of images, with a range of different underwater visibility and ambient light conditions, natural and man-made structures and dynamic camera motions. The forward-looking orientation of the camera makes these datasets unique and ideal for testing underwater obstacle-avoidance algorithms and for navigation close to the seafloor in dynamic environments. With our datasets, we hope to encourage the advancement of autonomous functionality for underwater vehicles in dynamic and/or shallow water environments.

The Aqualoc Dataset: Towards Real-Time Underwater Localization from a Visual-Inertial-Pressure Acquisition System

Real-Time Monocular Visual Odometry for Turbid and Dynamic Underwater Environments

Underwater AUV Navigation Dataset in Natural Scenarios

An Open-Source Platform For Underwater Image And Video Analytics

FLSea: Underwater Visual-Inertial and Stereo-Vision Forward-Looking Datasets

A Low Cost Visual Positioning System for Small Scale Tracking Experiments on Underwater Vehicles

HAUD: A High-Accuracy Underwater Dataset for Visual-Inertial Odometry

SVIn2: A multi-sensor fusion-based underwater SLAM system

CADDY Underwater Stereo-Vision Dataset for Human-Robot Interaction (HRI) in the Context of Diver Activities

A Visual–Inertial Pressure Fusion-Based Underwater Simultaneous Localization and Mapping System

Multi-modal Perception Dataset of In-water Objects for Autonomous Surface Vehicles

SVIn2: An Underwater SLAM System using Sonar, Visual, Inertial, and Depth Sensor

Opti-Acoustic Semantic SLAM with Unknown Objects in Underwater Environments

Vision-LiDAR-Inertial Localization and Mapping Dataset of a Mining Cave

Robust Inertial-aided Underwater Localization and Navigation based on Imaging Sonar Keyframes

FusionPortable: A Multi-Sensor Campus-Scene Dataset for Evaluation of Localization and Mapping Accuracy on Diverse Platforms

A Realistic Fish-Habitat Dataset to Evaluate Algorithms for Underwater Visual Analysis

Visual-Pressure Fusion for Underwater Robot Localization With Online Initialization

Self Calibration of a Sonar-Vision System for Underwater Vehicles: A New Method and a Dataset

FishTrack23: An Ensemble Underwater Dataset for Multi-Object Tracking

The LuViRA Dataset: Synchronized Vision, Radio, and Audio Sensors for Indoor Localization