Industrial Vision: Rectifying Millimeter-Level Edge Deviation in Industrial Internet of Things With Camera-Based Edge Device
Lei Xie,Zihao Chu,Yi Li,Tao Gu,Yanling Bu,Chuyu Wang,Sanglu Lu
DOI: https://doi.org/10.1109/tmc.2023.3246176
IF: 6.075
2023-01-01
IEEE Transactions on Mobile Computing
Abstract:Nowadays, to realize the intelligent manufacturing in Industrial Internet of Things (IIoT) scenarios, novel approaches in computer vision are in great demand to tackle the new challenges in IIoT environment. These approaches, which we call Industrial Vision, are expected to offer customized solutions for intelligent manufacturing in an accurate, time efficient and robust manner. In this paper, we propose a novel approach to industrial vision, called Edge-Eye, to rectify the edge deviation automatically for Irradiated Cross-linked Polyethylene Foam (IXPE) production with millimeter-level accuracy. IXPE has been one of the most commonly used materials in industry. During the production process of IXPE sheets, their edges need keep aligned strictly, otherwise, they could quickly get out of the border of the rolling plate and cause the huge economic loss. We deploy a commercial camera with mobile edge node in front of the IXPE sheet to continuously detect and rectify the edge deviation. Particularly, to handle the complex production environment when extracting the edge of IXPE sheet, we deploy a pair of reference bars with high-contrast colors to efficiently differentiate the sheet edge from the background. Then, we propose a Bi-direction Edge Tracking method to perform the edge detection from both vertical and horizontal aspects. To realize the rectification using mobile edge nodes with limited computing resources, we reduce the cost of computation by extracting the Minimized Region of Interest, i.e., the edge area overlapped with the higher contrast reference bar on both sides. We further design a negative feedback control system with multi-stage feedback regulation mechanism, keeping the edge deviation within millimeter-level. We implemented Edge-Eye on the ARM64 platform and performed evaluation in the practical IXPE production process. The experimental results show that Edge-Eye achieves the average accuracy of 5 mm for the edge deviation rectification, with the average latency of 200 ms for edge deviation detection. During the process of 20-month real deployment for 36 production lines, 66 manpower per day (90% of the overall manpower) has been saved, and the utilization rate of IXPE material increases from 87% to 94%.
computer science, information systems,telecommunications