Abstract:Manual handling is less efficient and sometimes even hazardous to humans in many areas, for example, agriculture. Using robots in those areas not only avoids human contact with such dangerous agricultural materials but also improves working efficiency. The motion of a robot is controlled using a technique called visual servoing that uses feedback information extracted from a vision sensor. In this study, a visual servoing method was proposed based on learning features and image moments for 3D targets to solve the problem of image moments-based visual servoing. A Gaussian process regression model was used to map the relationship between the image moment invariants and the rotational angles around the X- and Y-axes of the camera frame (denoted as gamma and beta). To obtain maximal decoupled structure and minimal nonlinearities of the image Jacobian matrix, it was assumed two image moment features, which are linearly proportional to gamma and beta. Combining the four image moment features of the normalized centroid coordinates, area, and orientation angle, a 6-DOF image moment-based visual servoing controller for the agricultural material handling robot was designed. Using this method, the problem of visual servoing task failure due to the singularity of the Jacobian matrix was solved, and it also had a better convergence effect for the part of the target image beyond the field of view from the initial pose and large displacement visual servoing system. The proposed algorithm was validated by carrying out experiments tracking bagged flour in a six-degree-of-freedom robotic system. The final displacement positioning accuracy reached the millimeter level and the direction angle positioning accuracy reached the level of 0.1 degrees. The method still has a certain convergence effect when the target image is beyond the field of view from the initial pose. The experimental results have been presented to show the adequate behavior of the presented approach in robot handling operations. It provides reference for the application of visual servoing technology in the field of agricultural robots and has important theoretical significance and practical value.

An Image-Based Visual Servo System to Operate a Flexible Wire

Visual Servo Control Of Cable-Driven Soft Robotic Manipulator

Visual Servoing of a Cable-Driven Soft Robot Manipulator with Shape Feature

Rigid and Flexible Structures Coupled System Study and Enhanced Vision-Aided Control for a Versatile Cable Winding Robot

Dynamic Modeling and Image-based Adaptive Visual Servoing of Cable-driven Soft Robotic Manipulator

Visual Servo Kinematic Control For Robotic Manipulators

Visual Tracking Control of Cable-Driven Hyper-Redundant Snake-Like Manipulator

Shape Control of Elastic Deformable Linear Objects for Robotic Cable Assembly

Analysis on an uncalibrated image-based visual servoing for 6 DOF industrial welding robots

Visual Servoing Experiment Using A 3d Flexible-Link Manipulator

An Image Based Visual Servo Approach with Deep Learning for Robotic Manipulation

Image Moments-Based Visual Servoing Control of Bagged Agricultural Materials Handling Robot

A Robust Visual Servoing Controller for Anthropomorphic Manipulators with Field-of-View Constraints and Swivel-Angle Motion: Overcoming System Uncertainty and Improving Control Performance

Vision-Based Task-Level Control of A Flexible-Link Manipulator

Vision-Based Robotic Grasping and Manipulation of USB Wires.

Adaptive Visual Servoing Shape Control of a Soft Robot Manipulator Using Bézier Curve Features

A Neuro-Fuzzy Visual Servoing Controller for an Articulated Manipulator

Image-Based Visual Servoing Control of Robot Manipulators Using Hybrid Algorithm with Feature Constraints.

Vision-Based Robotic Manipulation of Flexible PCBs

A Wireless Reconfigurable Modular Manipulator And Its Control System

A Real-Time 3-D Visual Detection-Based Soft Wire Avoidance Scheme for Industrial Robot Manipulators