Abstract:Multitarget tracking based on multisensor fusion perception is one of the key technologies to realize the intelligent driving of automobiles and has become a research hotspot in the field of intelligent driving. However, most current autonomous-vehicle target-tracking methods based on the fusion of millimeter-wave radar and lidar information struggle to guarantee accuracy and reliability in the measured data, and cannot effectively solve the multitarget-tracking problem in complex scenes. In view of this, based on the distributed multisensor multitarget tracking (DMMT) system, this paper proposes a multitarget-tracking method for autonomous vehicles that comprehensively considers key technologies such as target tracking, sensor registration, track association, and data fusion based on millimeter-wave radar and lidar. First, a single-sensor multitarget-tracking method suitable for millimeter-wave radar and lidar is proposed to form the respective target tracks; second, the Kalman filter temporal registration method and the residual bias estimation spatial registration method are used to realize the temporal and spatial registration of millimeter-wave radar and lidar data; third, use the sequential m-best method based on the new target density to find the track the correlation of different sensors; and finally, the IF heterogeneous sensor fusion algorithm is used to optimally combine the track information provided by millimeter-wave radar and lidar, and finally form a stable and high-precision global track. In order to verify the proposed method, a multitarget-tracking simulation verification in a high-speed scene is carried out. The results show that the multitarget-tracking method proposed in this paper can realize the track tracking of multiple target vehicles in high-speed driving scenarios. Compared with a single-radar tracker, the position, velocity, size, and direction estimation errors of the track fusion tracker are reduced by 85.5%, 64.6%, 75.3%, and 9.5% respectively, and the average value of GOSPA indicators is reduced by 19.8%; more accurate target state information can be obtained than a single-radar tracker.

Sensor Combinations in Heterogeneous Multi-sensor Fusion for Maritime Target Tracking

Coordinated Target Localization and Tracking with Node Scheduling for a Network of Autonomous Underwater Vehicles

Assisting the Visually Impaired: Multitarget Warning Through Millimeter Wave Radar and RGB-depth Sensors.

Bayesian information fusion and multitarget tracking for maritime situational awareness

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Practical Moving Target Detection in Maritime Environments Using Fuzzy Multi-sensor Data Fusion

Ship-to-Ship State Observer Using Sensor Fusion and the Extended Kalman Filter

Efficient Marine Track-to-Track Association Method for Multi-Source Sensors

Research on Fusion Tracking Technology in Heterogeneous Multi-Sensor

A Co-Operative Autonomous Offshore System for Target Detection Using Multi-Sensor Technology

Multitarget-Tracking Method Based on the Fusion of Millimeter-Wave Radar and LiDAR Sensor Information for Autonomous Vehicles

Maritime Ship Joint Detection and Localization Using GNSS-Based Passive Multistatic Radar

Research on multi-target tracking method based on multi-sensor fusion

Study on Multi-Heterogeneous Sensor Data Fusion Method Based on Millimeter-Wave Radar and Camera

Research on Active Intelligent Perception Technology of Vessel Situation Based on Multisensor Fusion

Acoustic-optic assisted multisensor navigation for autonomous underwater vehicles

Development and experimental evaluation of visual-acoustic navigation for safe maneuvering of unmanned surface vehicles in harbor and waterway areas

Radar-Based Multisensor Fusion for Uninterrupted Reliable Positioning in GNSS-Denied Environments

Robust Fusion of LiDAR and Wide-Angle Camera Data for Autonomous Mobile Robots

Multi-Sensor Data Fusion for Real-Time Multi-Object Tracking

Radar/Visual Fusion With Fuse-Before-Track Strategy For Low Altitude Non-Cooperative Sense And Avoid