A Deep Mutual Learning Based Strategy for Cloud-edge Collaborative Anomaly Detection in Cigarette Packaging

Liming Zhu,Jun Zhang,Wenbo Wang,Yingxuan Li,Xiaozhen Xu,Chunhui Zhao,Wenhai Wang
DOI: https://doi.org/10.1109/cac57257.2022.10055954
2022-01-01
Abstract:In order to ensure the delivery quality of products, anomaly detection technology is an important part of the production of cigarette packages. Recently, with the development of federated learning, it is possible for each production line in each factory to obtain better models by collaborative training without leaking data. However, due to the problem of data heterogeneity, the Global Shared Model (GSM) obtained by federated co-training can be worse than the local model which is only trained on private data of the edge. In this work, a deep mutual learning based strategy is proposed for cloud-edge collaborative anomaly detection, dealing with the Non-IIDness of data for each edge. Firstly, each edge side is trained collaboratively using FedAvg [1] algorithm to obtain the GSM. Then, the model personalization is performed at each edge side inspired by the idea of mutual learning. Specifically, a lightweight AE is initialized at edge side, called Lightweight Private Model (LPM), which has the same structure as GSM. The Feature extracted by the encoder of GSM and LPM are constrained by the smooth l 1 loss, and both GSM and LPM are guided by MSE loss to reconstruct normal samples like most previous unsupervised anomaly detection tasks. As a result, the encoder has stronger feature representation abilities through all edge co-training, and the entire LPM can be more adapted to the edge side tasks. Finally, we demonstrate the superiority of this method through anomaly detection experiments on our cigarette package dataset.
What problem does this paper attempt to address?