Abstract:In this paper, we present a dataset of diving gesture images used for human–robot interaction underwater. By offering this open access dataset, the paper aims at investigating the potential of using visual detection of diving gestures from an autonomous underwater vehicle (AUV) as a form of communication with a human diver. In addition to the image recording, the same dataset was recorded using a smart gesture recognition glove. The glove uses elastomer sensors and on-board processing to determine the selected gesture and transmit the command associated with the gesture to the AUV via acoustics. Although this method can be used under different visibility conditions and even without line of sight, it introduces a communication delay required for the acoustic transmission of the gesture command. To compare efficiency, the glove was equipped with visual markers proposed in a gesture-based language called CADDIAN and recorded with an underwater camera in parallel to the glove's onboard recognition process. The dataset contains over 30,000 underwater frames of nearly 900 individual gestures annotated in corresponding snippet folders. The dataset was recorded in a balanced ratio with five different divers in sea and five different divers in pool conditions, with gestures recorded at 1, 2 and 3 metres from the camera. The glove gesture recognition statistics are reported in terms of average diver reaction time, average time taken to perform a gesture, recognition success rate, transmission times and more. The dataset presented should provide a good baseline for comparing the performance of state of the art visual diving gesture recognition techniques under different visibility conditions.

Gesture-Based Autonomous Diving Buddy for Underwater Photography

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

A Method for Underwater Human–Robot Interaction Based on Gestures Tracking with Fuzzy Control

Robust Gesture-Based Communication for Underwater Human-Robot Interaction in the context of Search and Rescue Diver Missions

Interpretable Underwater Diver Gesture Recognition

Underwater Accompanying Robot Based on SSDLite Gesture Recognition

Gesture-based Human-robot Interaction for Field Programmable Autonomous Underwater Robots

A Diving Glove with Inertial Sensors for Underwater Gesture Recognition.

Understanding human motion and gestures for underwater human-robot collaboration

Diver-robot communication dataset for underwater hand gesture recognition

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

Underwater Intention Recognition using Head Motion and Throat Vibration for Supernumerary Robotic Assistance

Diver’s Hand Gesture Recognition and Segmentation for Human–robot Interaction on AUV

An Underwater Human-Robot Interaction Using a Visual-Textual Model for Autonomous Underwater Vehicles

Visual Diver Face Recognition for Underwater Human-Robot Interaction

An Underwater Human–Robot Interaction Using Hand Gestures for Fuzzy Control

Underwater Gesture Recognition Meta-Gloves for Marine Immersive Communication

DARE: AI-based Diver Action Recognition System using Multi-Channel CNNs for AUV Supervision

Smart-Data-Glove-Based Gesture Recognition for Amphibious Communication

Diver Identification Using Anthropometric Data Ratios for Underwater Multi-Human-Robot Collaboration

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans