Abstract:The use of underwater vehicle manipulator systems (UVMS) equipped with cameras has gained significant attention due to their capacity to perform underwater tasks autonomously. However, controlling both the manipulator and the remotely operated vehicle (ROV) based on the vision system information is not an easy task, especially in situations where the vehicle cannot be parked/held stationary. Most of the existing approaches work based on complex matrix calculations for the inverse kinematics (IK), which can lead to high computational costs and the need to deal with singularity problems. A problem arises when the amount of time needed to calculate the UVMS configuration can result in reduced frequency of target pose estimation, beyond the point where the target has moved out of the camera field of view. Therefore, this paper proposes an autonomous visual servoing approach for UVMS, including an extension of a heuristic technique named M-FABRIK (Mobile - Forward and Backward Reaching IK) to calculate the UVMS inverse kinematics in a simple and fast way. This approach aims to control both the configuration of the manipulator and ROV position in order to allow underwater intervention in situations where the ROV cannot be parked/held stationary. This solution allows the vehicle to be positioned according to additional criteria, besides avoiding matrix inversion and being robust to singularities. Trials have been performed with a manipulator mounted on a work-class ROV for an autonomous underwater monitoring task and results demonstrate a simple and fast approach, which is able to set the configuration of the manipulator as well as the ROV for visual servoing applications in real-time, such as for monitoring, tracking and intervention tasks underwater.

Adaptive Visual Servoing for an Underwater Soft Robot Considering Refraction Effects

Novel Online Optimized Control for Underwater Pipe-Cleaning Robots

A review on visual servoing for underwater vehicle manipulation systems automatic control and case study

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Reinforcement-Learning-Based Visual Servoing of Underwater Vehicle Dual-Manipulator System

Reconfigurable Transparent Variable‐Stiffness Soft Robot for Underwater Operations

Fully Automatic Visual Servoing Control for Underwater Vehicle Manipulator Systems Based on a Heuristic Inverse Kinematics

Visual Detection and Tracking System for a Spherical Amphibious Robot

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

A Self-triggered Position Based Visual Servoing Model Predictive Control Scheme for Underwater Robotic Vehicles

Underwater Target Following with a Vision-Based Autonomous Robotic Fish

Model Predictive Wave Disturbance Rejection for Underwater Soft Robotic Manipulators

A Novel Visual Sensor Stabilization Platform for Robotic Sharks Based on Improved LADRC and Digital Image Algorithm

Autoencoding a Soft Touch to Learn Grasping from On-land to Underwater

Underwater Target Tracking Control of an Untethered Robotic Fish With a Camera Stabilizer

Underwater Soft Robot Modeling and Control With Differentiable Simulation

Image-Based Composite Learning Robot Visual Servoing With an Uncalibrated Eye-to-Hand Camera

Adaptive Online Learning and Robust 3-D Shape Servoing of Continuum and Soft Robots in Unstructured Environments

Adaptive visual servoing control for uncalibrated robot manipulator with uncertain dead-zone constraint

Depth-Based Visual Servoing Using Low-Accurate Arm