A Multi-Level Eigenvalue Fusion Algorithm for 3D Multi-Object Tracking
Hantao Liu,Jianming Hu,Xingyu Li,Lihui Peng
DOI: https://doi.org/10.1061/9780784484319.022
2022-01-01
Abstract:Based on the sensing task in intelligent vehicle infrastructure cooperative systems (IVICS), this research mainly studied the end-to-end multi-target tracking method of multi-sensor fusion. Aiming at the fusion of point cloud data generated by lidar and camera vision, this paper studied the data level fusion method, 2D-3D fusion 3D object detection method, and 3D multi-object tracking method, respectively. Aiming at the vehicle object detection in intelligent transportation environment, this paper proposed a new extraction and fusion algorithm based on four levels of point cloud eigenvalue, and verified the algorithm model based on KITTI data set. In this study, by improving the PointFusion object detection algorithm, 3D multi-object detection was provided for traffic scenes, and the heterogeneous Pointnet ++ network was introduced to improve the performance of point cloud feature extraction. In this paper, the multi-level features of point cloud and the global features of image were extracted, respectively. Finally, the fusion of feature level provided a 3D multi-object detection model. The densefusion architecture was transformed into an end-to- end algorithm by data level fusion, and the performance of the model was optimized by bin based parameter classification estimation, multi-level feature extraction of point cloud, and focal loss of class balance.