Towards Continual Knowledge Transfer in Modeling Manufacturing Processes under Non-Stationary Data Streams

Tianyu Wang,Mian Li,Ruixiang Zheng,Changbing Cai,Yangbing Lou,Siqi Zhu
DOI: https://doi.org/10.1007/s10489-023-05034-0
IF: 5.3
2023-01-01
Applied Intelligence
Abstract:The multiple distinct yet related manufacturing processes running in a shop floor usually necessitates modeling these processes individually. However, the amount of collected data is imbalanced among these processes due to different production rates. Therefore, industrial knowledge transfer has been extensively investigated through transfer learning and continual learning. Existing work mostly assumes the availability of entire dataset prior to modeling, ignoring that real manufacturing data often arrives sequentially in a non-stationary stream. Some recent studies enable the model to adapt to such data stream, yet they fail to consider the frequent alternation of multiple processes. To address these issues, a novel paradigm is proposed in this paper for the continual knowledge transfer in modeling multiple manufacturing processes. The proposed paradigm takes into account both linear and non-linear model families. For linear models, the Intercept Separated Recursive Least Squares (IS-RLS) algorithm with variable forgetting factors is introduced that transfers the knowledge about disturbances. For non-linear models, the important parameters of source domain model are dynamically identified and transferred based on the formulation of a neural network with Memory Aware Synapses (MAS) and variable learning rates. Extensive experiments are conducted on two shop floors of a large factory. The collected data streams involve multiple product categories with diverse production rates. The proposed paradigm outperforms the state-of-the-art methods and achieves significant improvement over baselines. The results can boost the practical applications of process modeling in large-scale manufacturing.
What problem does this paper attempt to address?