Abstract:Multi-object tracking (MOT) has important applications in monitoring, logistics, and other fields. This paper develops a real-time multi-object tracking and prediction system in rugged environments. A 3D object detection algorithm based on Lidar-camera fusion is designed to detect the target objects. Based on the Hungarian algorithm, this paper designs a 3D multi-object tracking algorithm with an adaptive threshold to realize the stable matching and tracking of the objects. We combine Memory Augmented Neural Networks (MANN) and Kalman filter to achieve 3D trajectory prediction on rugged terrains. Besides, we realize a new dynamic SLAM by using the results of multi-object tracking to remove dynamic points for better SLAM performance and static map. To verify the effectiveness of the proposed multi-object tracking and prediction system, several simulations and physical experiments are conducted. The results show that the proposed system can track dynamic objects and provide future trajectory and a more clean static map in real-time.

What problem does this paper attempt to address?

This paper attempts to solve the problems of multi - object detection, tracking and prediction in complex dynamic environments. Specifically, the paper focuses on how to achieve efficient and accurate multi - object real - time tracking and future trajectory prediction in rough and dynamic environments. To meet this challenge, the author proposes a 3D multi - object detection algorithm that combines Lidar and Camera data fusion, and an adaptive - threshold 3D multi - object tracking algorithm based on the Hungarian algorithm. In addition, a method combining Memory - Augmented Neural Network (MANN) and Kalman Filter is introduced to improve the accuracy and robustness of 3D trajectory prediction. Finally, by using the results of multi - object tracking to remove dynamic points, dynamic SLAM (Simultaneous Localization and Mapping) is improved to obtain a higher - quality static map. The main contributions of the paper can be summarized as follows: 1. **Proposing an adaptive - threshold 3D multi - object tracking algorithm**: It solves the problem that traditional matching methods are prone to matching errors under non - uniform motion or changing - direction motion, and improves the precision of multi - object tracking. 2. **Developing a new trajectory prediction method**: By combining MANN and Kalman Filter, the prediction error of moving objects on rough terrain is reduced, and the robustness of trajectory prediction is enhanced. 3. **Implementing a real - time dynamic point removal method based on the tracking and prediction system**: This method can effectively remove dynamic points, thereby improving SLAM performance and obtaining a higher - quality static map. The comprehensive application of these technologies enables the proposed system to achieve real - time, accurate multi - object detection, tracking and prediction in complex dynamic environments, providing strong technical support for fields such as surveillance and logistics.

Multi-object Detection, Tracking and Prediction in Rugged Dynamic Environments

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Detecting and Tracking Dynamic Objects in Complex Environments

Object tracking with 3D LIDAR via multi-task sparse learning

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Dynamic Multi-LiDAR Based Multiple Object Detection and Tracking

MAT: Motion-Aware Multi-Object Tracking

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

Rlm-tracking: online multi-pedestrian tracking supported by relative location mapping

Semantic geometric fusion multi-object tracking and lidar odometry in dynamic environment

LiDAR-based Real-Time Object Detection and Tracking in Dynamic Environments

MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking

3D Multi-object Detection and Tracking with Sparse Stationary LiDAR

3D Multi-Object Tracking in Point Clouds Based on Prediction Confidence-Guided Data Association

An IMM-Enabled Adaptive 3D Multi-Object Tracker for Autonomous Driving

Spatial-Semantic and Temporal Attention Mechanism-Based Online Multi-Object Tracking

Dynamic Object Tracking for Self-Driving Cars Using Monocular Camera and LIDAR.

Real-time Multi-Object Tracking Based on Bi-directional Matching

Know Your Surroundings: Panoramic Multi-Object Tracking by Multimodality Collaboration