AGV State Monitoring Based on Global and First-person View Fusion in Digital Workshops

Xudong Yuan,Yinlong Zhang,Wei Liang,Haibo An,Sichao Zhang,Gengyu Li
DOI: https://doi.org/10.1109/CYBER55403.2022.9907186
2022-07-27
Abstract:AGV state monitoring is becoming increasingly important for production system safety in digital workshops. This paper develops a global and first-person view fusion to monitor the AGV (Automated Guided Vehicle) running state in the complex digital workshops. Based on the affine transformation model, the AGV running states, i.e., position, velocity and orientation are estimated by the global camera with the assistance of ArUco markers, which are pasted on the front side of the AGV. Besides, the first-person view camera is used to implement pedestrian detection and distance measurement based on the YOLOv3 model. It is noticeable that the pitch angle is considered for distance measurement, and an improved triangular model for distance measurement is proposed. The effectiveness of the proposed method has been verified in our built platform.
Computer Science,Engineering
What problem does this paper attempt to address?