Abstract:In the era of intelligence and automation, robots play a significant role in the field of automated welding, enhancing efficiency and precision. However, challenges persist in scenarios demanding complexity and higher precision, such as low welding planning efficiency and inaccurate weld seam defect detection. Therefore, based on digital twin technology and kernel correlation filtering algorithm, a welding tracking model is proposed. Firstly, the kernel correlation filtering algorithm is used to train the filter on the first frame of the collected image, determine the position of image features in the region, extract histogram features of image blocks, and then train the filter using ridge regression to achieve welding trajectory tracking. Additionally, an intelligent weld seam detection model is introduced, employing a backbone feature network for feature extraction, feature fusion through a feature pyramid, and quality detection of weld seams through head classification. During testing of the tracking model, the maximum tracking error is −0.232 mm, with an average absolute tracking error of 0.08 mm, outperforming other models. Comparatively, in tracking accuracy, the proposed model exhibits the fastest convergence with a precision rate of 0.845, surpassing other models. In weld seam detection, the proposed model excels with a detection accuracy of 97.35% and minimal performance loss at 0.023. In weld seam quality and melt depth error detection, the proposed model achieves errors within the range of −0.06 mm, outperforming the other two models. These results highlight the outstanding detection capabilities of the proposed model. The research findings will serve as technical references for the development of automated welding robots and welding quality inspection.

Weld feature extraction method based on inter-frame constraint and dynamic template

A Feature Matching Algorithm Applied to Welding Trajectory Revising

A 3D Vision-Based Weld Seam Extraction Method for Arbitrarily Placed Spatial Planar Weldments

Discerning Weld Seam Profiles from Strong Arc Background for the Robotic Automated Welding Process via Visual Attention Features

Intelligent Perception and Seam Tracking System for Thick Plate Weldments Based on Constant-Focus Optical Path

Active visual continuous seam tracking based on adaptive feature detection and particle filter tracking

An automatic feature point extraction method based on laser vision for robotic multi-layer multi-pass weld seam tracking

Weld seam track identification for industrial robot based on illumination correction and center point extraction

A weld seam feature real-time extraction method of three typical welds based on target detection

A Method of Feature Extraction of Position Detection and Weld Gap for GMAW Seam Tracking System of Fillet Weld With Variable Gaps

Point Cloud 3D Weldment Reconstruction and Welding Feature Extraction for Robotic Multi-bead Arc Weld Cladding Path Plaanning

Welding robot automation technology based on digital twin

Additive seam tracking technology based on laser vision

Feature Extraction of Welding Seam Image Based on Laser Vision

Feature point extraction based on contour detection and corner detection for weld seam

Robust weld seam tracking method based on detection and tracking of laser stripe

Automatic Weld Recognition and Extraction from Real-Time X-Ray Images Using Quadratic Curve Fitting and Multi-Order Differences Analysis of Intensity Profile

A real-time seam tracking system based on extraction and restoration model in robotic GMAW

Weld seam profile extraction using top-down visual attention and fault detection and diagnosis via EWMA for the stable robotic welding process

3D vision-based weld seam extraction method

Research on Welding Guidance System of Intelligent Perception for Steel Weldment