Abstract:A goal in ultrasonic welding (USW) process monitoring is to accurately predict quality outcomes based on monitored signals. However, in most cases, knowing only that the USW process has failed is insufficient. Modern process automation should assess signal information and intercede to rectify process problems. Identification of when a process signal deviates from an acceptable final quality outcome, i.e., the time at which an abnormal event starts, facilitates control action or root cause analysis to bring it back to compliance. A long short-term memory (LSTM) recurrent neural network is proposed to monitor USW and other time-series signals and identify this point. This deep neural network is trained to classify quality outcomes from continuous signals. The process monitoring signals and their sampling time are divided into finite segments as input to this network. The time segment at which the process signal first converges to the final quality class prediction is identified using cross-entropy of the classification probabilities. This procedure is demonstrated using USW quality monitoring algorithms and robot motion failure detection. The examples show an LSTM network not only provides high accuracy for USW quality prediction, but also that the time of classification convergence is consistent with variance observed in USW weld quality factors. Moreover, classification convergence time was shown to be associated to specific robot motion failures, useful as input to adaptive learning. This work realizes deep-learning driven quality prediction and early event detection for quality classification problems, and provides the information necessary for adaptive control algorithms.

Cooperative Deep Dynamic Feature Extraction and Variable Time-Delay Estimation for Industrial Quality Prediction

Gated Quality-Driven Feature Extraction with A Hybrid SIAE Model for Industrial Soft Sensor

Dynamic Time Features Expanding and Extracting Method for Prediction Model of Sintering Process Quality Index

Stacked Spatial–Temporal Autoencoder for Quality Prediction in Industrial Processes

Long-short Memory with Feature Representation by Latent-variable Model for Industrial Soft Sensor

Deep Nonlinear Dynamic Feature Extraction for Quality Prediction Based on Spatiotemporal Neighborhood Preserving SAE

An Adversarial Bidirectional Serial–parallel LSTM-based QTD Framework for Product Quality Prediction

Weighted Nonlinear Dynamic System for Deep Extraction of Nonlinear Dynamic Latent Variables and Industrial Application

Multivariate Deep Reconstruction Neural Network for Multi-step-ahead Prediction of Industrial Process Quality Variables

Dynamic Feature Extractor for Industrial Key Variable Prediction Based on Enhanced Gating Mechanism

A Spatiotemporal Industrial Soft Sensor Modeling Scheme for Quality Prediction With Missing Data

Deep Learning of Complex Batch Process Data and Its Application on Quality Prediction

Real-time Estimation of Quality-Related Variable for Dynamic and Non-Gaussian Process Based on Semisupervised Bayesian HMM

Dynamic Features Incorporated Locally Weighted Deep Learning Model for Soft Sensor Development.

Sintering Quality Prediction Model Based on Semi-Supervised Dynamic Time Feature Extraction Framework

A Multiphase Dual Attention-Based LSTM Neural Network for Industrial Product Quality Prediction

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

A Faster Dynamic Feature Extractor and Its Application to Industrial Quality Prediction

A dynamic feature selection-based data-driven quality prediction method for soft sensing in the diesel engine assembly system

Big Data Quality Prediction in the Process Industry: A Distributed Parallel Modeling Framework

Automatic Deep Extraction of Robust Dynamic Features for Industrial Big Data Modeling and Soft Sensor Application