Abstract:Multitarget tracking based on multisensor fusion perception is one of the key technologies to realize the intelligent driving of automobiles and has become a research hotspot in the field of intelligent driving. However, most current autonomous-vehicle target-tracking methods based on the fusion of millimeter-wave radar and lidar information struggle to guarantee accuracy and reliability in the measured data, and cannot effectively solve the multitarget-tracking problem in complex scenes. In view of this, based on the distributed multisensor multitarget tracking (DMMT) system, this paper proposes a multitarget-tracking method for autonomous vehicles that comprehensively considers key technologies such as target tracking, sensor registration, track association, and data fusion based on millimeter-wave radar and lidar. First, a single-sensor multitarget-tracking method suitable for millimeter-wave radar and lidar is proposed to form the respective target tracks; second, the Kalman filter temporal registration method and the residual bias estimation spatial registration method are used to realize the temporal and spatial registration of millimeter-wave radar and lidar data; third, use the sequential m-best method based on the new target density to find the track the correlation of different sensors; and finally, the IF heterogeneous sensor fusion algorithm is used to optimally combine the track information provided by millimeter-wave radar and lidar, and finally form a stable and high-precision global track. In order to verify the proposed method, a multitarget-tracking simulation verification in a high-speed scene is carried out. The results show that the multitarget-tracking method proposed in this paper can realize the track tracking of multiple target vehicles in high-speed driving scenarios. Compared with a single-radar tracker, the position, velocity, size, and direction estimation errors of the track fusion tracker are reduced by 85.5%, 64.6%, 75.3%, and 9.5% respectively, and the average value of GOSPA indicators is reduced by 19.8%; more accurate target state information can be obtained than a single-radar tracker.

Study on Multi-Heterogeneous Sensor Data Fusion Method Based on Millimeter-Wave Radar and Camera

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Radar and Camera Fusion for Multi-Task Sensing in Autonomous Driving

Millimeter-Wave Radar and Vision Fusion Target Detection Algorithm Based on an Extended Network

Data Fusion of Roadside Camera, LiDAR and Millimeter Wave Radar

Vehicle Detection Based on Information Fusion of mmWave Radar and Monocular Vision

Vehicle detection based on millimeter-wave radar and image fusion techniques

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Traffic Incident Detection Based on mmWave Radar and Improvement Using Fusion with Camera

Fusion Perception of Vision and Millimeter Wave Radar for Autonomous Driving

Multi-sensor Fusion Detection Method for Vehicle Target Based on Kalman Filter and Data Association Filter

Target Detection Algorithm Based on MMW Radar and Camera Fusion

Radar and Camera Fusion Based Moving Obstacle Tracking for Automated Vehicles

Augmented Millimeter Wave Radar and Vision Fusion Simulator for Roadside Perception

Robust Target Detection, Position Deducing and Tracking Based on Radar Camera Fusion in Transportation Scenarios.

Research of Target Detection and Classification Techniques Using Millimeter-Wave Radar and Vision Sensors

Road vehicle detection based on multi-sensor fusion

Multitarget-Tracking Method Based on the Fusion of Millimeter-Wave Radar and LiDAR Sensor Information for Autonomous Vehicles

Robust Target Recognition and Tracking of Self-Driving Cars With Radar and Camera Information Fusion Under Severe Weather Conditions