Abstract:Aiming at the stability of hand-eye calibration in fruit picking scene, a simple hand-eye calibration method for picking robot based on optimization combined with TOF (Time of Flight) camera is proposed. This method needs to fix the TOF depth camera at actual and calculated coordinates of the peach the end of the robot, operate the robot to take pictures of the calibration board from different poses, and record the current photographing poses to ensure that each group of pictures is clear and complete, so as to use the TOF depth camera to image the calibration board. Obtain multiple sets of calibration board depth maps and corresponding point cloud data, that is, "eye" data. Through the circle center extraction and positioning algorithm, the circle center points on each group of calibration plates are extracted, and a circle center sorting method based on the vector angle and the center of mass coordinates is designed to solve the circle center caused by factors such as mirror distortion, uneven illumination and different photographing poses. And through the tool center point of the actuator, the coordinate value of the circle center point on the four corners of each group of calibration plates in the robot end coordinate system is located in turn, and the "hand" data is obtained. Combined with the SVD method, And according to the obtained point residuals, the weight coefficients of the marker points are redistributed, and the hand-eye parameters are iteratively optimized, which improves the accuracy and stability of the hand-eye calibration. the method proposed in this paper has a better ability to locate the gross error under the environment of large gross errors. In order to verify the feasibility of the hand-eye calibration method, the indoor picking experiment was simulated, and the peaches were identified and positioned by combining deep learning and 3D vision to verify the proposed hand-eye calibration method. The JAKA six-axis robot and TuYang depth camera are used to build the experimental platform. The experimental results show that the method is simple to operate, has good stability, and the calibration plate is easy to manufacture and low in cost. work accuracy requirements.

Deep Vision Servo Hand-Eye Coordination Planning Study for Sorting Robots

Recognition and Distance Estimation of an Irregular Object in Package Sorting Line Based on Monocular Vision

Visual Sorting of Express Parcels Based on Multi-Task Deep Learning

Design of YUMI Collaborative Robot Sorting System Based on Machine Vision

A Low-Cost, High-Speed, and Robust Bin Picking System for Factory Automation Enabled by a Non-Stop, Multi-View, and Active Vision Scheme

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

A novel hand-eye calibration method of picking robot based on TOF camera

A Food Package Recognition and Sorting System Based on Structured Light and Deep Learning

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Development of Multi-Robotic Arm System for Sorting System Using Computer Vision

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Multi-robot Coordination for High-Speedpick-and-place Tasks.

Ellipse Detection Based Bin-Picking Visual Servoing System

Economical Precise Manipulation and Auto Eye-Hand Coordination with Binocular Visual Reinforcement Learning

Hand-Eye Calibration Technology of Intelligent Picking Robot Using Multiple Photoelectric Sensor Information Fusion

Research on Machine Vision Technology of High Speed Robot Sorting System based on Deep Learning

A “Global–Local” Visual Servo System for Picking Manipulators

Study on Intelligent Visual Servoing of Space Robot for Cooperative Target Capturing

Towards One Shot & Pick All: 3D-OAS, an end-to-end framework for vision guided top-down parcel bin-picking using 3D-overlapping-aware instance segmentation and GNN

Design of assembly line material sorting system based on machine vision

Research on Intelligent Logistics Sorting Robot Control Based on Machine Vision