Abstract:The use of autonomous underwater vehicles (AUVs) to accomplish traditionally challenging and dangerous tasks has proliferated thanks to advances in sensing, navigation, manipulation, and on-board computing technologies. Utilizing AUVs in underwater human-robot interaction (UHRI) has witnessed comparatively smaller levels of growth due to limitations in bi-directional communication and significant technical hurdles to bridge the gap between analogies with terrestrial interaction strategies and those that are possible in the underwater domain. A necessary component to support UHRI is establishing a system for safe robotic-diver approach to establish face-to-face communication that considers non-standard human body pose. In this work, we introduce a stereo vision system for enhancing UHRI that utilizes three-dimensional reconstruction from stereo image pairs and machine learning for localizing human joint estimates. We then establish a convention for a coordinate system that encodes the direction the human is facing with respect to the camera coordinate frame. This allows automatic setpoint computation that preserves human body scale and can be used as input to an image-based visual servo control scheme. We show that our setpoint computations tend to agree both quantitatively and qualitatively with experimental setpoint baselines. The methodology introduced shows promise for enhancing UHRI by improving robotic perception of human orientation underwater.

A Method for Underwater Human–Robot Interaction Based on Gestures Tracking with Fuzzy Control

An Underwater Human–Robot Interaction Using Hand Gestures for Fuzzy Control

Gesture-based Human-robot Interaction for Field Programmable Autonomous Underwater Robots

An Underwater Human-Robot Interaction Using a Visual-Textual Model for Autonomous Underwater Vehicles

Understanding human motion and gestures for underwater human-robot collaboration

Underwater Accompanying Robot Based on SSDLite Gesture Recognition

Diver’s Hand Gesture Recognition and Segmentation for Human–robot Interaction on AUV

Gesture-Based Autonomous Diving Buddy for Underwater Photography

Underwater Intention Recognition using Head Motion and Throat Vibration for Supernumerary Robotic Assistance

Autonomous robotic re-alignment for face-to-face underwater human-robot interaction

Visual identification of biological motion for underwater human–robot interaction

Robust Gesture-Based Communication for Underwater Human-Robot Interaction in the context of Search and Rescue Diver Missions

A Diving Glove with Inertial Sensors for Underwater Gesture Recognition.

Visual Detection of Diver Attentiveness for Underwater Human-Robot Interaction

Dynamic Reconfiguration of Mission Parameters in Underwater Human-Robot Collaboration

Interpretable Underwater Diver Gesture Recognition

Visual Diver Face Recognition for Underwater Human-Robot Interaction

Integrating augmented reality, gesture recognition, and NLP for enhancing underwater human-robot interaction

Underwater Vehicle Gesture Control Aided by Air Bubble Motion Observation

Using Monocular Vision and Human Body Priors for AUVs to Autonomously Approach Divers

Underwater Human-Robot and Human-Swarm Interaction: A Review and Perspective