Abstract:In vision-based robotic manipulation, it is usually required that the object should present a desired shape or be viewed at a specific angle to facilitate subsequent operations such as object crawling and component inspection. To implement this kind of visual servoing tasks, image features that describe shape information of objects need to be designed. This paper proposes methods based on the general contour of an object. The Bezier curve and the nonuniform rational B-spline curve are, respectively, used to fit the contour of the object. Based on contour curve parameters, image contour features are designed. Visual measurements of the image features are used to provide feedback on the shape information of the object to the eye-in-hand visual servoing system. Based on the visual feedback, the motion of the robot is controlled to make the image features converge to the desired values. In this way, it is implemented that the object presents the desired shape or is viewed at the desired angle. Moreover, by using adaptive laws to estimate curve parameters online, the proposed method does not require a priori knowledge of the 3-D position of the object. The stability of the proposed controller is analyzed by Lyapunov theory. This method has substantially expanded the application domain of not only the image feature-based visual servoing, but also the B-spline curves. The feasibility of the proposed method is validated by experiments.

Shape Reconstruction for Continuum Robot Based on Pythagorean Hodograph–Bézier Curve With IMU and Vision Sensors

Orientation to Pose: Continuum Robots Shape Reconstruction Based on the Multi-Attitude Solving Approach

Shape Reconstruction Method for Continuum Robot Using FBG Sensors

Shape Reconstruction of Soft Continuum Robots Via the Fusion of Local Strains and Global Poses

Orientation to Pose: Continuum Robots Shape Sensing Based on Piecewise Polynomial Curvature Model

Shape reconstruction for wire-driven flexible robots based on Bézier curve and electromagnetic positioning

Robust Tracking of Dexterous Continuum Robots: Fusing FBG Shape Sensing and Stereo Vision

An Interactive Control Approach to 3D Shape Reconstruction

Shape Sensing for Continuum Robots by Capturing Passive Tendon Displacements With Image Sensors

Adaptive Visual Servoing Shape Control of a Soft Robot Manipulator Using Bézier Curve Features

Shape Tracking and Navigation for Continuum Surgical Robot Based on Magnetic Tracking.

A Shape Reconstruction and Visualization Method for a Flexible Hinged Plate Using Binocular Vision

Adaptive Visual Servoing of Contour Features

Reconstruction method with twisting measurement and compensation for shape sensing of flexible robots

REAL-TIME SHAPE ESTIMATION OF CURVILINEAR FLEXIBLE SURGICAL ROBOTS: METHODS, EXPERIMENTS AND ANALYSIS

Shape-Reconstruction-Based Force Sensing Method for Continuum Surgical Robots with Large Deformation

An iterative closest point algorithm for marker-free 3D shape registration of continuum robots

Pilot Study On Shape Sensing For Continuum Tubular Robot With Multi-Magnet Tracking Algorithm

A New Approach for Solving the Inverse Kinematics of Continuum Robot Based on Piecewise Constant Curvature Model

Investigation on the Shape Reconstruction of Cable-Driven Continuum Manipulators Considering Super-Large Deflections and Variable Structures

Shape Reconstruction of FBG Intelligent Flexible Structure Based on B-spline Fitting