Abstract:A goal in ultrasonic welding (USW) process monitoring is to accurately predict quality outcomes based on monitored signals. However, in most cases, knowing only that the USW process has failed is insufficient. Modern process automation should assess signal information and intercede to rectify process problems. Identification of when a process signal deviates from an acceptable final quality outcome, i.e., the time at which an abnormal event starts, facilitates control action or root cause analysis to bring it back to compliance. A long short-term memory (LSTM) recurrent neural network is proposed to monitor USW and other time-series signals and identify this point. This deep neural network is trained to classify quality outcomes from continuous signals. The process monitoring signals and their sampling time are divided into finite segments as input to this network. The time segment at which the process signal first converges to the final quality class prediction is identified using cross-entropy of the classification probabilities. This procedure is demonstrated using USW quality monitoring algorithms and robot motion failure detection. The examples show an LSTM network not only provides high accuracy for USW quality prediction, but also that the time of classification convergence is consistent with variance observed in USW weld quality factors. Moreover, classification convergence time was shown to be associated to specific robot motion failures, useful as input to adaptive learning. This work realizes deep-learning driven quality prediction and early event detection for quality classification problems, and provides the information necessary for adaptive control algorithms.

A Novel Bidirectional Gated Recurrent Unit-Based Soft Sensor Modeling Framework for Quality Prediction in Manufacturing Processes

A Spatiotemporal Industrial Soft Sensor Modeling Scheme for Quality Prediction With Missing Data

An Adversarial Bidirectional Serial–parallel LSTM-based QTD Framework for Product Quality Prediction

A Soft Sensor Model of Sintering Process Quality Index Based on Multi-Source Data Fusion.

Multivariate Deep Reconstruction Neural Network for Multi-step-ahead Prediction of Industrial Process Quality Variables

Cooperative Deep Dynamic Feature Extraction and Variable Time-Delay Estimation for Industrial Quality Prediction

A Novel Incremental Gaussian Mixture Regression and Its Application for Time-varying Multimodal Process Quality Prediction

Adaptive Soft Sensors for Quality Prediction under the Framework of Bayesian Network

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

Real-time Estimation of Quality-Related Variable for Dynamic and Non-Gaussian Process Based on Semisupervised Bayesian HMM

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

Weighted Nonlinear Dynamic System for Deep Extraction of Nonlinear Dynamic Latent Variables and Industrial Application

A Novel Semi-supervised Two-dimensional Dynamic Soft Sensor for Quality Prediction in Batch Processes

Quality Prediction of Industrial Polyethylene Process with Robust Long Short Term Memory Model

A Novel Soft Sensor Modeling Approach Based on Difference-LSTM for Complex Industrial Process

Path Enhanced Bidirectional Graph Attention Network for Quality Prediction in Multistage Manufacturing Process

Deep Learning of Complex Batch Process Data and Its Application on Quality Prediction

A Multiphase Dual Attention-Based LSTM Neural Network for Industrial Product Quality Prediction

Multi-grain Cascade Recurrent Neural Network for Nonlinear Time-varying Process Soft Sensor Modeling

A new approach for quality prediction and control of multistage production and manufacturing process based on Big Data analysis and Neural Networks

Bayesian Network for Dynamic Variable Structure Learning and Transfer Modeling of Probabilistic Soft Sensor