Knowledge Distillation-based Information Sharing for Online Process Monitoring in Decentralized Manufacturing System

Zhangyue Shi,Yuxuan Li,Chenang Liu
2023-07-26
Abstract:In advanced manufacturing, the incorporation of sensing technology provides an opportunity to achieve efficient in-situ process monitoring using machine learning methods. Meanwhile, the advances of information technologies also enable a connected and decentralized environment for manufacturing systems, making different manufacturing units in the system collaborate more closely. In a decentralized manufacturing system, the involved units may fabricate same or similar products and deploy their own machine learning model for online process monitoring. However, due to the possible inconsistency of task progress during the operation, it is also common that some units have more informative data while some have less informative data. Thus, the monitoring performance of machine learning model for each unit may highly vary. Therefore, it is extremely valuable to achieve efficient and secured knowledge sharing among the units in a decentralized manufacturing system for enhancement of poorly performed models. To realize this goal, this paper proposes a novel knowledge distillation-based information sharing (KD-IS) framework, which could distill informative knowledge from well performed models to improve the monitoring performance of poorly performed models. To validate the effectiveness of this method, a real-world case study is conducted in a connected fused filament fabrication (FFF)-based additive manufacturing (AM) platform. The experimental results show that the developed method is very efficient in improving model monitoring performance at poorly performed models, with solid protection on potential data privacy.
Machine Learning,Signal Processing
What problem does this paper attempt to address?
The problem that this paper attempts to solve is that in a decentralized manufacturing system, due to the inconsistent data volume and data quality of each manufacturing unit, the performance of machine - learning models in some units in online process monitoring is poor. Specifically: 1. **Differences in data distribution**: Even if all units produce the same or similar products, due to differences in working conditions (such as equipment, materials, operations, etc.), the data collected by different units may follow similar but not exactly the same distribution. This makes knowledge sharing difficult. 2. **Data privacy protection**: Some units may be reluctant to directly share their valuable data, so a method that can perform knowledge sharing without disclosing data is required. To solve these problems, the paper proposes an information - sharing framework based on knowledge distillation (KD - IS), which aims to distill the knowledge of data - rich units (i.e., units with more or higher - quality data) to improve the monitoring performance of data - scarce units (i.e., units with less or lower - quality data), while ensuring the security of data privacy. ### Specific problem summary: - **How to achieve effective knowledge sharing in a decentralized manufacturing system** to improve the online process monitoring performance of data - scarce units. - **How to apply knowledge distillation in the case of different data distributions** and ensure that data privacy is not violated. Through these improvements, the paper hopes to use the knowledge distillation technology to improve the monitoring efficiency and performance of the entire manufacturing system without directly sharing the original data.