Abstract:The purpose of this thesis is to propose a 6DoF grasping position measurement strategy for robots based on monocular vision in response to the problems of high cost and poor stability of 6DoF grasping position measurement of target workpieces when industrial robots are grasping metal workpieces under vision system. The strategy adopts a simple structure, low-cost, easy-to-deploy monocular vision system to collect industrial sample data, and through the introduction of virtual reality technology and generative adversarial network, to realize the purpose of data enhancement for industrial metal small sample objects with surface defects and interference from the external environment, to solve the problem of insufficient data due to the difficulty of acquiring data in complex environments, and to achieve the problem of insufficient data due to the later application of monocular vision system as well. The purpose of continuously updating and expanding the sample data can be achieved by applying the monocular vision system in the later stage. At the same time, combining the deep learning-based multi-keypoint object detection technology and 2D-3D affine transformation, the method realizes the accurate measurement of the 6DoF position of the target workpiece. This method can measure the 6DoF position of industrial metal parts only by 2D plane images, and is a new method to estimate the 6DoF pose of a given object from a single RGB image using monocular vision, which possesses the ability to detect the pose of target objects with low-cost, stable, and strong antiinterference, reduces the cost of using robotic vision guidance technology in the industrial field, and provides a new way of thinking for monocular vision to be adopted by the industrial field. Provide a new idea for monocular vision to be adopted by the industrial field. Experiments show that the method has good detection accuracy for industrial small sample objects.

Research on 6DOF Gripping Position Measurement Strategy of Robot Based on Monocular Vision

Research on 6DOF Pose Measurement Algorithm of Industrial Metal Workpiece Based on Binocular Vision

WireframePose: Monocular 6D Pose Estimation of Metal Parts Based on Wireframe Extraction and Matching

A novel robotic 6DOF pose measurement strategy for large-size casts based on stereo vision

6D Pose Estimation Method of Metal Parts for Robotic Grasping Based on Semantic-Level Line Matching

A 6DOF pose measurement method for metal casts object based on stereo vision sensor

Realization of odometry system using monocular vision

A Positioning System Based on Monocular Vision for Industrial Robots

Analysis on an uncalibrated image-based visual servoing for 6 DOF industrial welding robots

A Two-Stage Monocular Vision Detection Method for 6D Pose Estimation in Multi-Heterogeneous Robot Systems

Research on the Industrial Robot Grasping Method Based on Multisensor Data Fusion and Binocular Vision

Robot Target Location Based on the Difference in Monocular Vision Projection

An Object Localization System Using Monocular Camera and Two-Axis-Controlled Laser Ranging Sensor for Mobile Robot

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Improve the Estimation of Monocular Vision 6-DOF Pose Based on the Fusion of Camera and Laser Rangefinder

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Visual Tracking And Grasping Of Moving Objects And Its Application To An Industrial Robot

Single-Camera Multi-View 6DoF pose estimation for robotic grasping

A Generative Feature-to-Image Robotic Vision Framework for 6D Pose Measurement of Metal Parts

Design of an Unordered Gripping System Based on 3D Vision

High-Precision Monocular Vision Guided Robotic Assembly Based on Local Pose Invariance