Abstract:Purpose Soft robotics, regarded as a new research branch of robotics, has generated increasing interests in this decade and has demonstrated its outperformance in addressing safety issues when cooperating with human beings. However, there is still lack of accurate close-loop control because of the difficulty in acquiring feedback information and accurately modeling the system, especially in interactive environments. To this end, this paper aims to improve the controllability of the soft robot working in specific underwater environment. The system dynamics, which takes complicated hydrodynamics into account, is solved using Kane's method. The dynamics-based adaptive visual servoing controller is proposed to realize accurate sensorimotor control. Design/methodology/approach This paper presents an image-based visual servoing control scheme for a cable-driven soft robot with a fixed camera observing the motions. The intrinsic and extrinsic parameters of the camera can be adapted online so that tedious camera calibration work can be eliminated. It is acknowledged that kinematics-based control can be only applied into tasks in the free space and has limitation in accelerating the motion speed of robot arms. That is, one must consider the unneglectable interaction effects generated from the environment and objectives when operating soft robots in such interactive control tasks. To extend the application of soft robots into underwater environment, the study models system dynamics considering complicated hydrodynamic effects. With the pre-knowledge of the external effects, the performance of the robot can be further improved by adding the compensation term into the controller. Findings The proposed controller has theoretically proved its convergence of image error, adaptive estimation error and the stability of the dynamical system based on Lyapunov's analysis. The authors also validate the performance of the controller in positioning control task in an underwater environment. The controller shows its capacity of rapid convergence to and accurate tracking performance of a static image target in a physical experiment. Originality/value To the best of the authors' knowledge, there is no such research before that has developed dynamics-based visual servoing controller which takes into account the environment interactions. This work can thus improve the control accuracy and enhance the applicability of soft robotics when operating in complicated environments.

Underwater Vehicle Visual Servo and Target Grasp Control

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

Terminal Underwater Docking of an Autonomous Underwater Vehicle Using One Camera and One Light

Performance Analysis of Feature Extraction Methods Towards Underwater Vslam

A Low Cost Visual Positioning System for Small Scale Tracking Experiments on Underwater Vehicles

A review on visual servoing for underwater vehicle manipulation systems automatic control and case study

Real-Time Panoramic System for Underwater Cleaning Robot

Binocular Vision Based Locating System for Underwater Inspection

View-based Underwater SLAM Using a Stereo Camera

Image-Based Visual Servoing for USV under Wave Perturbations

Adaptive Visual Servoing for an Underwater Soft Robot Considering Refraction Effects

Integrated Target Recognition and Grasp Control for the Underwater Vehicle–Manipulator System

Reinforcement-Learning-Based Visual Servoing of Underwater Vehicle Dual-Manipulator System

Underwater Dynamic Visual Servoing for A Soft Robot Arm with Online Distortion Correction

Real-Time Perception and Positioning for Creature Picking of an Underwater Vehicle

Underwater Target Detection and 3D Reconstruction System Based on Binocular Vision.

Image-based Visual Servo Control for UUV Recovery System under Field of View Constraints

Research on underwater robot ranging technology based on semantic segmentation and binocular vision

Adaptive Visual Servoing Control for an Underwater Soft Robot

Underwater vehicle vision information capturing and processing algorithm

Real-Time Underwater Onboard Vision Sensing System for Robotic Gripping