Abstract:In the process of industrial production, manual assembly of workpieces exists with low efficiency and high intensity, and some of the assembly process of the human body has a certain degree of danger. At the same time, traditional machine learning algorithms are difficult to adapt to the complexity of the current industrial field environment; the change in the environment will greatly affect the accuracy of the robot's work. Therefore, this paper proposes a method based on the combination of machine vision and the YOLOv5 deep learning model to obtain the disk porous localization information, after coordinate mapping by the ROS communication control robotic arm work, in order to improve the anti-interference ability of the environment and work efficiency but also reduce the danger to the human body. The system utilizes a camera to collect real-time images of targets in complex environments and, then, trains and processes them for recognition such that coordinate localization information can be obtained. This information is converted into coordinates under the robot coordinate system through hand–eye calibration, and the robot is then controlled to complete multi-hole localization and tracking by means of communication between the upper and lower computers. The results show that there is a high accuracy in the training and testing of the target object, and the control accuracy of the robotic arm is also relatively high. The method has strong anti-interference to the complex environment of industry and exhibits a certain feasibility and effectiveness. It lays a foundation for achieving the automated installation of docking disk workpieces in industrial production and also provides a more favorable choice for the production and installation of the process of screw positioning needs.

Peg-in-hole assembly in live-line maintenance based on generative mapping and searching network

Learning-based Optimization Algorithms Combining Force Control Strategies for Peg-in-Hole Assembly.

Learning A Simulation-based Visual Policy for Real-world Peg in Unseen Holes.

Learning A Simulation-based Visual Policy for Real-world Peg In Unseen Holes

Learning Active Force–Torque Based Policy for Sub-mm Localization of Unseen Holes

Vision-based robotic peg-in-hole research: integrating object recognition, positioning, and reinforcement learning

Multiple Peg-in-Hole Assembly of Tightly Coupled Multi-manipulator Using Learning-based Visual Servo

Quickly Inserting Pegs into Uncertain Holes using Multi-view Images and Deep Network Trained on Synthetic Data

A Noncontact Control Strategy for Circular Peg-in-Hole Assembly Guided by the 6-DOF Robot Based on Hybrid Vision

Peg-in-Hole Assembly Based on Six-Legged Robots with Visual Detecting and Force Sensing

Position/Force Visual-Sensing-Based Robotic Sheet-Like Peg-in-Hole Assembly

Mastering Autonomous Assembly in Fusion Application with Learning-by-doing: a Peg-in-hole Study

Deep Siamese Neural Network-Driven Model for Robotic Multiple Peg-in-Hole Assembly System

Multitarget Adaptive Virtual Fixture Based on Task Learning for Hydraulic Manipulator

Multiple peg-in-hole compliant assembly based on a learning-accelerated deep deterministic policy gradient strategy

Learning-based Contact Status Recognition for Peg-in-Hole Assembly

Visual Spatial Attention and Proprioceptive Data-Driven Reinforcement Learning for Robust Peg-in-Hole Task Under Variable Conditions

An Approach for Peg-in-Hole Assembling Based on Force Feedback Control

Fast robust peg-in-hole insertion with continuous visual servoing

Peg-in-Hole Assembly Based on Two-phase Scheme and F/T Sensor for Dual-arm Robot

Research on Multi-Hole Localization Tracking Based on a Combination of Machine Vision and Deep Learning