Abstract:A goal in ultrasonic welding (USW) process monitoring is to accurately predict quality outcomes based on monitored signals. However, in most cases, knowing only that the USW process has failed is insufficient. Modern process automation should assess signal information and intercede to rectify process problems. Identification of when a process signal deviates from an acceptable final quality outcome, i.e., the time at which an abnormal event starts, facilitates control action or root cause analysis to bring it back to compliance. A long short-term memory (LSTM) recurrent neural network is proposed to monitor USW and other time-series signals and identify this point. This deep neural network is trained to classify quality outcomes from continuous signals. The process monitoring signals and their sampling time are divided into finite segments as input to this network. The time segment at which the process signal first converges to the final quality class prediction is identified using cross-entropy of the classification probabilities. This procedure is demonstrated using USW quality monitoring algorithms and robot motion failure detection. The examples show an LSTM network not only provides high accuracy for USW quality prediction, but also that the time of classification convergence is consistent with variance observed in USW weld quality factors. Moreover, classification convergence time was shown to be associated to specific robot motion failures, useful as input to adaptive learning. This work realizes deep-learning driven quality prediction and early event detection for quality classification problems, and provides the information necessary for adaptive control algorithms.

Prediction of high power laser welding status based on PCA and SVM classification of multiple sensors

Real-time monitoring of high-power disk laser welding statuses based on deep learning framework

Multiscale feature extraction and its application in the weld seam quality prediction for plasma arc welding

A Weld Joint Type Identification Method for Visual Sensor Based on Image Features and SVM

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

Prediction of weld back width based on top vision sensing during laser-MIG hybrid welding

Multi-Output Monitoring of High-Speed Laser Welding State Based on Deep Learning

Filter-PCA-Based Process Monitoring and Defect Identification During Climbing Helium Arc Welding Process Using DE-SVM

Prediction algorithm of molten pool width based on support vector machine during high-power disk laser welding

In situ monitoring and penetration prediction of plasma arc welding based on welder intelligence-enhanced deep random forest fusion

Quantitative Detection of Laser Welding Defective Structure Based on Feature Exaction of the Pulsed Eddy Current Signal

Research on a Feature Point Detection Algorithm for Weld Images Based on Deep Learning

Real-Time Weld Quality Prediction Using a Laser Vision Sensor in a Lap Fillet Joint during Gas Metal Arc Welding

Prediction of penetration based on plasma plume and spectrum characteristics in laser welding

Discerning Weld Seam Profiles from Strong Arc Background for the Robotic Automated Welding Process via Visual Attention Features

Multiple weld seam laser vision recognition method based on the IPCE algorithm

Detection and Strong Classification of Natural Weld Defects by Magneto-Optical Imaging Under Rotating Magnetic Field Excitation

Vision sensing system and detection of backside image of molten pool in laser-MIG hybrid welding

Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network

Online detection of weld surface defects based on improved incremental learning approach