A Visual SLAM With Tightly-Coupled Integration of Multi-Object Tracking for Production Workshop
Rongsong Gou,Guangzhu Chen,Xin Pu,Xiaojuan Liao,Runji Chen
DOI: https://doi.org/10.1109/jiot.2024.3368417
IF: 10.6
2024-01-01
IEEE Internet of Things Journal
Abstract:The application of simultaneous localization and mapping (SLAM) technology has a noteworthy potential for enhancing the cognitive capability of production workshops, particularly for complex and ever-changing industrial settings. In the production workshop, obtaining the information of dynamic objects in a scene is key of accurate Visual SLAM. This article proposes a tightly coupled SLAM method (TCvSLAM), which can accurately obtain SE(3) pose information on cameras, as well as motion information on moving objects in a scene. The proposed method first uses a simple extended Kalman filter-based tracker to determine the actual motion state of objects and associate it. Next, the extracted features are classified into static background features and object features based on the object instance mask information and object state information. Static features are used to initialize camera poses, whereas dynamic features are used to obtain SE(3) pose information on tracked objects in the considered scene. Finally, a new graph optimization method is proposed to optimize the static three-dimensional landmarks, object three-dimensional landmarks, camera poses, and poses of moving objects in a scene jointly. The TCvSLAM is verified on the KITTI dataset and the OMD dataset compared with the ORBSLAM2, the ORBSLAM3 and the VDOSLAM, then the performance evaluation of the TCvSLAM in real environment is also conducted. The experimental results validate the effectiveness of the TCvSLAM.
computer science, information systems,telecommunications,engineering, electrical & electronic