Abstract:A goal in ultrasonic welding (USW) process monitoring is to accurately predict quality outcomes based on monitored signals. However, in most cases, knowing only that the USW process has failed is insufficient. Modern process automation should assess signal information and intercede to rectify process problems. Identification of when a process signal deviates from an acceptable final quality outcome, i.e., the time at which an abnormal event starts, facilitates control action or root cause analysis to bring it back to compliance. A long short-term memory (LSTM) recurrent neural network is proposed to monitor USW and other time-series signals and identify this point. This deep neural network is trained to classify quality outcomes from continuous signals. The process monitoring signals and their sampling time are divided into finite segments as input to this network. The time segment at which the process signal first converges to the final quality class prediction is identified using cross-entropy of the classification probabilities. This procedure is demonstrated using USW quality monitoring algorithms and robot motion failure detection. The examples show an LSTM network not only provides high accuracy for USW quality prediction, but also that the time of classification convergence is consistent with variance observed in USW weld quality factors. Moreover, classification convergence time was shown to be associated to specific robot motion failures, useful as input to adaptive learning. This work realizes deep-learning driven quality prediction and early event detection for quality classification problems, and provides the information necessary for adaptive control algorithms.

Design of Real-time Monitoring System for Laser Penetration Welding

Real-time monitoring of high-power disk laser welding statuses based on deep learning framework

Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network

DSP-based Real-time Seam Tracking System for Large-sized Stainless Steel Welded Pipes

Penetration State Recognition during Laser Welding Process Control Based on Two-Stage Temporal Convolutional Networks

The Intelligent Methodology for Monitoring the Dynamic Welding Quality Using Visual and Audio Sensor

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

Review of laser welding monitoring

A penetration depth monitoring method for Al-Cu laser lap welding based on spectral signals

Finite element simulation of welding process and real-time monitoring assessment

In-Process Visual Monitoring of Penetration State in Nuclear Steel Pipe Welding

Measurement of pulsed laser welding penetration based on keyhole dynamics and deep learning approach

In situ monitoring and penetration prediction of plasma arc welding based on welder intelligence-enhanced deep random forest fusion

Sensing and Control System of Process Quality in Co2 Laser Deep Penetration Welding

Supervised deep learning for real-time quality monitoring of laser welding with X-ray radiographic guidance

Multi-Output Monitoring of High-Speed Laser Welding State Based on Deep Learning

Welding Quality Monitoring of High Frequency Straight Seam Pipe Based on Image Feature

Penetration Monitoring and Control of CO 2 Laser Welding with Coaxial Visual Sensing System

Online monitoring system for welding states of bottom-locking joints in high-speed trains via multi-information fusion and 3DCNN

Prediction of high power laser welding status based on PCA and SVM classification of multiple sensors

Monitoring of Laser Welding Using Source Localization and Tracking Processing by Microphone Array