Abstract:We present an algorithm for underwater robots to visually detect and track human motion. Our objective is to enable human–robot interaction by allowing a robot to follow behind a human moving in (up to) six degrees of freedom. In particular, we have developed a system to allow a robot to detect, track and follow a scuba diver by using frequency-domain detection of biological motion patterns. The motion of biological entities is characterized by combinations of periodic motions which are inherently distinctive. This is especially true of human swimmers. By using the frequency-space response of spatial signals over a number of video frames, we attempt to identify signatures pertaining to biological motion. This technique is applied to track scuba divers in underwater domains, typically with the robot swimming behind the diver. The algorithm is able to detect a range of motions, which includes motion directly away from or towards the camera. Once detected, the motion of the diver relative to the vehicle is then tracked using an Unscented Kalman Filter, an approach for non-linear estimation. The efficiency of our approach makes it attractive for real-time applications on-board our underwater vehicle, and in future applications we intend to track scuba divers in real-time with the robot. The paper presents an algorithmic overview of our approach, together with experimental evaluation based on underwater video footage.

A Learning-Based Tracking for Diving Motions

Tracking Athletes in Diving Videos Based on Pose Learning

Classify Motion Model via SVM to Track Underwater Maneuvering Target

A Robust and Fast Model-Based Athlete Contour Tracking in Diving Videos

A GIM-based approach for biomimetic robot motion learning.

Particle Filter with Multiple Motion Models for Object Tracking in Diving Video Sequences

A Video Tracking Algorithm for Diving Based on Adaptive Particle Filtering

Motion Control of a Multi-Joint Robotic Fish Based on Biomimetic Learning

A new approach to human motion sequence recognition with application to diving actions

Exploring Learning-based Motion Models in Multi-Object Tracking

Learning-based Tracking of Complex Non-Rigid Motion

Visual identification of biological motion for underwater human–robot interaction

3D Human Body Shape and Motion Tracking by LBS and Snake

Combining template matching and model fitting for human body segmentation and tracking with applications to sports training

Automatic detection and recognition of athlete actions in diving video

Deep reinforcement learning for tracking a moving target in jellyfish-like swimming

A Global Motion Estimation Method for Diving Video Sequences

Tracking Undulatory Body Motion Of Multiple Fish Based On Midline Dynamics Modeling

Tracking Object Contour Using A Novel B-Snake Algorithm

Tracking Full-Body Motion of Multiple Fish with Midline Subspace Constrained Multicue Optimization

Automatic Video-based Analysis of Athlete Action