Abstract:In the era of intelligence and automation, robots play a significant role in the field of automated welding, enhancing efficiency and precision. However, challenges persist in scenarios demanding complexity and higher precision, such as low welding planning efficiency and inaccurate weld seam defect detection. Therefore, based on digital twin technology and kernel correlation filtering algorithm, a welding tracking model is proposed. Firstly, the kernel correlation filtering algorithm is used to train the filter on the first frame of the collected image, determine the position of image features in the region, extract histogram features of image blocks, and then train the filter using ridge regression to achieve welding trajectory tracking. Additionally, an intelligent weld seam detection model is introduced, employing a backbone feature network for feature extraction, feature fusion through a feature pyramid, and quality detection of weld seams through head classification. During testing of the tracking model, the maximum tracking error is −0.232 mm, with an average absolute tracking error of 0.08 mm, outperforming other models. Comparatively, in tracking accuracy, the proposed model exhibits the fastest convergence with a precision rate of 0.845, surpassing other models. In weld seam detection, the proposed model excels with a detection accuracy of 97.35% and minimal performance loss at 0.023. In weld seam quality and melt depth error detection, the proposed model achieves errors within the range of −0.06 mm, outperforming the other two models. These results highlight the outstanding detection capabilities of the proposed model. The research findings will serve as technical references for the development of automated welding robots and welding quality inspection.

DeepKP: A Robust and Accurate Framework for Weld Seam Keypoint Extraction in Welding Robots

Research on a Feature Point Detection Algorithm for Weld Images Based on Deep Learning

Robust seam tracking via a deep learning framework combining tracking and detection

An efficient and robust complex weld seam feature point extraction method for seam tracking and posture adjustment

Coarse-to-Fine Detection of Multiple Seams for Robotic Welding

An automatic feature point extraction method based on laser vision for robotic multi-layer multi-pass weld seam tracking

A weld feature points detection method based on improved YOLO for welding robots in strong noise environment

Welding robot automation technology based on digital twin

A Feature Matching Algorithm Applied to Welding Trajectory Revising

Discerning Weld Seam Profiles from Strong Arc Background for the Robotic Automated Welding Process via Visual Attention Features

Weld feature extraction method based on inter-frame constraint and dynamic template

Real-time weld seam feature extraction in construction sites

Weld Seam Identification and Tracking of Inspection Robot Based on Deep Learning Network

Weld Seam Detection Method with Rotational Region Proposal Network.

Intelligent Seam Tracking of an Ultranarrow Gap During K-TIG Welding: A Hybrid CNN and Adaptive ROI Operation Algorithm

A Deep Meta-Metric Learning Method for Few-Shot Weld Seam Visual Detection

LSFP-tracker: an autonomous laser stripe feature point extraction algorithm based on siamese network for robotic welding seam tracking

Robust welding seam tracking using image seam extraction

A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robot

High-resolution Weld Defect Detection with RSU-MLP and Dynamic Kernel Supervision

Welding seam recognition and tracking for a novel mobile welding robot based on multi-layer sensing strategy