Abstract:Industrial robots have become more diverse and common for automating manufacturing processes, such as welding. Existing robotic control, however, is incapable of adaptively adjusting its operation in response to a dynamic welding environment, whereas a skilled human welder can. Sophisticated and adaptive robotic control relies on the effective and efficient processing of perception data, characterization and prediction of highly dynamic systems, and real-time adaptative robotic reactions. This research presents a preliminary study on developing appropriate Machine Learning (ML) techniques for real-time welding quality prediction and adaptive welding speed adjustment for GTAW welding at a constant current. In order to collect the data needed to train the hybrid ML models, two cameras are applied to monitor the welding process, with one camera (available in practical robotic welding) recording the top-side weld pool dynamics and a second camera (unavailable in practical robotic welding, but applicable for training purpose) recording the back-side bead formation. Given these two data sets, correlations can be discovered through a convolutional neural network (CNN) that is good at image characterization. With the CNN, top-side weld pool images can be analyzed to predict the back-side bead width during active welding control. Furthermore, the monitoring process has been applied to multiple experimental trials with varying speeds. This allowed the effect of welding speed on bead width to be modeled through a Multi-Layer Perceptron (MLP). Through the trained MLP, a computationally efficient gradient descent algorithm has been developed to adjust the travel speed accordingly to achieve an optimal bead width with full material penetration. Because of the nature of gradient descent, the robot would change faster when the quality is further away and then fine-tune the speed when it was close to the goal. Experimental studies have shown promising results on real-time bead width prediction and adaptive speed adjustment to realize ideal bead width.

Method for monitoring and controlling penetration of complex groove welding based on online multi-modal data

Online Monitoring and Control of Butt-Welded Joint Penetration during GMAW

Online identification of burn-through and weld deviation in sheet lap MIG welding based on YOLOv5

Active visual continuous seam tracking based on adaptive feature detection and particle filter tracking

Intelligent Methodology for Sensing, Modeling, and Control of Weld Penetration in Robotic Welding System.

Robotic Seam Tracking System Based on Vision Sensing and Human-Machine Interaction for Multi-Pass MAG Welding

Online Monitoring and Model-Free Adaptive Control of Weld Penetration in VPPAW Based on Extreme Learning Machine.

A Welding Seam Tracking Algorithm Adaptive to Variable Groove Type: an Interactive Segmentation Passive Vision Method

Online Measurement of the Gmaw Process Using Composite Sensor Technology

Measurement and estimation of weld pool surface depth and weld penetration in pulsed gas metal arc welding

Real-Time Sensing of Sag Geometry During GTA Welding

Groove-center Detection in Gas Metal Arc Welding Using a Template-Matching Method

Vision-Based Acquisition Model for Molten Pool and Weld-Bead Profile in Gas Metal Arc Welding

Closed-loop Control of Medium-Thickness Plate Arc Welding Based on Weld-Face Vision Sensing

Vision Sensing and Feedback Control of Weld Penetration in Helium Arc Welding Process

Hybrid machine learning-enabled adaptive welding speed control

Welding Penetration Monitoring for Pulsed GTAW Using Visual Sensor Based on AAM and Random Forests

Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning

A Method of Feature Extraction of Position Detection and Weld Gap for GMAW Seam Tracking System of Fillet Weld With Variable Gaps

On-line detection system of weld-based rapid prototyping process based on structured light

Penetration Control of GTAW Process for Aluminum Alloy Using Vision Sensing