Abstract:Welding seam tracking based on online programming is the future trend of intelligent production. However, most of the existing image processing methods have certain limitations in the adaptability, accuracy, and robustness of weld feature point detection. The online welding method of gas metal arc welding (GMAW) based on active vision sensing is studied in this paper. The Steger sub-pixel detection method is used to guarantee the accuracy of feature point extraction, and a self-adaptive search window and self-adaptive slope extraction are proposed on this basis. The self-adaptive window is generated according to the linear information of the weld area, and the scale factor and range threshold constraint are added to realize the real-time detection of the weld feature information. Screening the center pixel of the laser stripe in the self-adaptive window of the current frame by the initial slope or the self-adaptive slope of the previous frame, the linear information of the weld area is obtained. The self-adaptive slope of the current frame is fitted by the random sampling consistency method, and the pixel margin is retained to adapt to the linear detection of different continuous welds. When arc light and other serious interference make it difficult to obtain weld information, a particle filter is used to make the best prediction of the weld position. Finally, the welding robot platform based on laser vision sensing was built to test various continuous welds of the butt weld, fillet weld, and lap weld. Experimental results show that the detection speed is 27 ms, and the accuracy of detection and tracking can respectively reach 0.03 mm and 0.78 mm, which meets the requirements of weld detection and tracking.

Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding

Robust welding seam tracking using image seam extraction

Robust seam tracking via a deep learning framework combining tracking and detection

Discerning Weld Seam Profiles from Strong Arc Background for the Robotic Automated Welding Process via Visual Attention Features

A real-time seam tracking system based on extraction and restoration model in robotic GMAW

Active visual continuous seam tracking based on adaptive feature detection and particle filter tracking

An automatic feature point extraction method based on laser vision for robotic multi-layer multi-pass weld seam tracking

A Method of Feature Extraction of Position Detection and Weld Gap for GMAW Seam Tracking System of Fillet Weld With Variable Gaps

Seam tracking system based on laser vision and CGAN for robotic multi-layer and multi-pass MAG welding

A weld feature points detection method based on improved YOLO for welding robots in strong noise environment

Research on a Feature Point Detection Algorithm for Weld Images Based on Deep Learning

Intelligent Seam Tracking in Foils Joining Based on Spatial–temporal Deep Learning from Molten Pool Serial Images

A study on the modified Hough algorithm for image processing in weld seam tracking

Coarse-to-Fine Detection of Multiple Seams for Robotic Welding

Multiple weld seam laser vision recognition method based on the IPCE algorithm

Weld Seam Identification and Tracking of Inspection Robot Based on Deep Learning Network

Weld Seam Recognition Based On CCD Image Processing

Robotic Seam Tracking System Combining Lightweight Segmentation Network Design and ADMM-Based Structured Pruning

Denoising and feature extraction of weld seam profiles by stacked denoising autoencoder

Seam Feature Point Acquisition Based on Efficient Convolution Operator and Particle Filter in GMAW

Robust weld seam tracking method based on detection and tracking of laser stripe