Abstract:Welding Procedure Designed assures the desired weld penetration be produced under nominal welding conditions. When conditions deviate from the nominal, penetration and other welding outcomes deviate from their desired/targeted ones. To assure the penetration not below minimally necessary, well-designed Procedure should reserve an appropriate margin per estimated condition deviations. An ideal solution is to use relatively small margin but dynamically adjust welding pa-rameters to maintain the penetration at minimally necessary/within the margin. As such, the penetration state should be monitored in real-time during manufacturing. Unfortunately, it occurs underneath workpieces and is not considered directly observable during manufacturing so that its real-time in-situ moni-toring is challenging. In the last half century, researchers have focused on finding promising real-time observable phenomena and correlating such phenomena to penetration. This has been difficult as it is unclear what are critical in observed phenomena and trial-and-error iterative processes are practiced proposing features, developing algorithms to calculate them, fitting model from features, and then modifying model, features, or algorithms if fitting accuracy is not acceptable. Such iterative process is not automated, finding/fitting right features/model takes months if not longer, and success is not assured. In particular, algorithms to calculate features vary from features to features and each of them requires extensive tests. Deep learning automates and combines featuring and fitting to maximally use the raw information directly to achieve highest accuracies. Computation is drastically increased but the iterative process is replaced by an automated one so that the time frame is still drastically reduced. This paper reviews various raw information that has been used as the observed phenomena to input into deep learning models and analyzes why they may correlate to penetration; reviews various deep learning models and analyzes why/how they may and are needed to correlate different raw information to penetration; and briefly reviews major techniques that have been used to train deep learning models in penetration prediction. Based on such analyses, this paper identifies major achievements and issues for efforts taken so far to monitor weld penetration using deep learning approaches. Finally, we identify two fundamental issues that require revolutionary solutions in order to move the deep learning technologies from laboratory studies to manufacturing as directions for future efforts. These two issues are analyzed and some preliminary solution directions are proposed.

In situ monitoring and penetration prediction of plasma arc welding based on welder intelligence-enhanced deep random forest fusion

Visual-Acoustic Penetration Recognition in Variable Polarity Plasma Arc Welding Process Using Hybrid Deep Learning Approach

Weld Penetration Identification for VPPAW Based on Keyhole Features and Extreme Learning Machine

Welding Penetration Monitoring for Pulsed GTAW Using Visual Sensor Based on AAM and Random Forests

Rapid Inference for Penetration Prediction of Plasma Arc Welding Using Enhanced ShuffleNetV2 and FOS-ELM

Penetration/keyhole status prediction and model visualization based on deep learning algorithm in plasma arc welding

Deep Learning Based Real-Time and In-Situ Monitoring of Weld Penetration: Where We Are and What Are Needed Revolutionary Solutions?

Vppaw Penetration Monitoring Based on Fusion of Visual and Acoustic Signals Using T-Sne and Dbn Model

Multiscale feature extraction and its application in the weld seam quality prediction for plasma arc welding

Weld Penetration in Situ Prediction from Keyhole Dynamic Behavior under Time-Varying VPPAW Pools Via the OS-ELM Model

Online Monitoring and Penetration Recognition in All-Position TIG Welding of Nuclear Power Pipeline

Machine Learning-Based In-Process Monitoring for Laser Deep Penetration Welding: A Survey

Deep Learning-Based Detection of Penetration from Weld Pool Reflection Images

Online Monitoring and Model-Free Adaptive Control of Weld Penetration in VPPAW Based on Extreme Learning Machine.

Penetration prediction of narrow-gap laser welding based on coaxial high dynamic range observation and machine learning

EMD- PNN Based Welding Defects Detection Using Laser-Induced Plasma Electrical Signals

Real-time monitoring of high-power disk laser welding statuses based on deep learning framework

Real-time Identification of Molten Pool and Keyhole Using a Deep Learning-Based Semantic Segmentation Approach in Penetration Status Monitoring

Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network

Prediction of penetration based on plasma plume and spectrum characteristics in laser welding

An end-to-end framework based on acoustic emission for welding penetration prediction