Abstract:Open-source benchmark datasets have been a critical component for advancing machine learning for robot perception in terrestrial applications. Benchmark datasets enable the widespread development of state-of-the-art machine learning methods, which require large datasets for training, validation, and thorough comparison to competing approaches. Underwater environments impose several operational challenges that hinder efforts to collect large benchmark datasets for marine robot perception. Furthermore, a low abundance of targets of interest relative to the size of the search space leads to increased time and cost required to collect useful datasets for a specific task. As a result, there is limited availability of labeled benchmark datasets for underwater applications. We present the AI4Shipwrecks dataset, which consists of 28 distinct shipwrecks totaling 286 high-resolution labeled side scan sonar images to advance the state-of-the-art in autonomous sonar image understanding. We leverage the unique abundance of targets in Thunder Bay National Marine Sanctuary in Lake Huron, MI, to collect and compile a sonar imagery benchmark dataset through surveys with an autonomous underwater vehicle (AUV). We consulted with expert marine archaeologists for the labeling of robotically gathered data. We then leverage this dataset to perform benchmark experiments for comparison of state-of-the-art supervised segmentation methods, and we present insights on opportunities and open challenges for the field. The dataset and benchmarking tools will be released as an open-source benchmark dataset to spur innovation in machine learning for Great Lakes and ocean exploration. The dataset and accompanying software are available at <a class="link-external link-https" href="https://umfieldrobotics.github.io/ai4shipwrecks/" rel="external noopener nofollow">this https URL</a>.

A machine vision meta-algorithm for automated recognition of underwater objects using sidescan sonar imagery

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

Performance Analysis of Feature Extraction Methods Towards Underwater Vslam

An Open-Source Platform For Underwater Image And Video Analytics

Computer vision methods for side scan sonar imagery

Visual Detection And Feature Recognition Of Underwater Target Using A Novel Model-Based Method

Underwater object classification combining SAS and transferred optical-to-SAS Imagery

Underwater Object Recognition Using Point-Features, Bayesian Estimation and Semantic Information

Generation and Processing of Simulated Underwater Images for Infrastructure Visual Inspection with UUVs

YOLOv5-Based Seabed Sediment Recognition Method for Side-Scan Sonar Imagery

Opti-Acoustic Semantic SLAM with Unknown Objects in Underwater Environments

Using SPOT-5 HRG Data in Panchromatic Mode for Operational Detection of Small Ships in Tropical Area

Machine Learning for Shipwreck Segmentation from Side Scan Sonar Imagery: Dataset and Benchmark

On-Line Multi-Class Segmentation of Side-Scan Sonar Imagery Using an Autonomous Underwater Vehicle

Advanced deep learning framework for underwater object detection with multibeam forward-looking sonar

Real-time underwater target detection for AUV using side scan sonar images based on deep learning

Integrating Sonar and Stereo Vision for Enhanced Subsea Infrastructure Maintenance

Online Informative Sampling using Semantic Features in Underwater Environments

Underwater Slam Algorithm Based on Image Sonar Salient Target Detection

Deep Learning for Enhanced Marine Vision: Object Detection in Underwater Environments

An Adaptive and Online Underwater Image Processing Algorithm Implemented on Miniature Biomimetic Robotic Fish