Abstract:Welding Procedure Designed assures the desired weld penetration be produced under nominal welding conditions. When conditions deviate from the nominal, penetration and other welding outcomes deviate from their desired/targeted ones. To assure the penetration not below minimally necessary, well-designed Procedure should reserve an appropriate margin per estimated condition deviations. An ideal solution is to use relatively small margin but dynamically adjust welding pa-rameters to maintain the penetration at minimally necessary/within the margin. As such, the penetration state should be monitored in real-time during manufacturing. Unfortunately, it occurs underneath workpieces and is not considered directly observable during manufacturing so that its real-time in-situ moni-toring is challenging. In the last half century, researchers have focused on finding promising real-time observable phenomena and correlating such phenomena to penetration. This has been difficult as it is unclear what are critical in observed phenomena and trial-and-error iterative processes are practiced proposing features, developing algorithms to calculate them, fitting model from features, and then modifying model, features, or algorithms if fitting accuracy is not acceptable. Such iterative process is not automated, finding/fitting right features/model takes months if not longer, and success is not assured. In particular, algorithms to calculate features vary from features to features and each of them requires extensive tests. Deep learning automates and combines featuring and fitting to maximally use the raw information directly to achieve highest accuracies. Computation is drastically increased but the iterative process is replaced by an automated one so that the time frame is still drastically reduced. This paper reviews various raw information that has been used as the observed phenomena to input into deep learning models and analyzes why they may correlate to penetration; reviews various deep learning models and analyzes why/how they may and are needed to correlate different raw information to penetration; and briefly reviews major techniques that have been used to train deep learning models in penetration prediction. Based on such analyses, this paper identifies major achievements and issues for efforts taken so far to monitor weld penetration using deep learning approaches. Finally, we identify two fundamental issues that require revolutionary solutions in order to move the deep learning technologies from laboratory studies to manufacturing as directions for future efforts. These two issues are analyzed and some preliminary solution directions are proposed.

Weld Penetration in Situ Prediction from Keyhole Dynamic Behavior under Time-Varying VPPAW Pools Via the OS-ELM Model

Weld Penetration Identification for VPPAW Based on Keyhole Features and Extreme Learning Machine

Online Monitoring and Model-Free Adaptive Control of Weld Penetration in VPPAW Based on Extreme Learning Machine.

Weld Joint Penetration State Sequential Identification Algorithm Based on Representation Learning of Weld Images

Collaborative and Quantitative Prediction for Reinforcement and Penetration Depth of Weld Bead Based on Molten Pool Image and Deep Residual Network

A Prediction Model for Keyhole Geometry and Acoustic Signatures During Variable Polarity Plasma Arc Welding Based on Extreme Learning Machine

Intelligent Methodology for Sensing, Modeling, and Control of Weld Penetration in Robotic Welding System.

In situ monitoring and penetration prediction of plasma arc welding based on welder intelligence-enhanced deep random forest fusion

Predicting the Weld Width from High-Speed Successive Images of the Weld Zone Using Different Machine Learning Algorithms During Laser Welding

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

Deep Learning Based Real-Time and In-Situ Monitoring of Weld Penetration: Where We Are and What Are Needed Revolutionary Solutions?

Penetration prediction of narrow-gap laser welding based on coaxial high dynamic range observation and machine learning

Monitoring of Weld Joint Penetration During Variable Polarity Plasma Arc Welding Based on the Keyhole Characteristics and Pso-Anfis

Accurate Prediction of the Weld Bead Characteristic in Laser Keyhole Welding Based on the Stochastic Kriging Model

Visual-Acoustic Penetration Recognition in Variable Polarity Plasma Arc Welding Process Using Hybrid Deep Learning Approach

Penetration/keyhole status prediction and model visualization based on deep learning algorithm in plasma arc welding

Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning

Welding Penetration Monitoring for Pulsed GTAW Using Visual Sensor Based on AAM and Random Forests

A VMD-BP Model to Predict Laser Welding Keyhole-Induced Pore Defect in Al Butt-Lap Joint

Modeling and numerical study of the molten pool dynamics during scanning electron beam welding of aluminum alloys: Physical mechanism, prediction and parameter selection

How to Accurately Monitor the Weld Penetration From Dynamic Weld Pool Serial Images Using CNN-LSTM Deep Learning Model?