Multitarget Vehicle Tracking and Motion State Estimation Using a Novel Driving Environment Perception System of Intelligent Vehicles

Yuren Chen,Xinyi Xie,Bo Yu,Yi Li,Kunhui Lin

DOI: https://doi.org/10.1155/2021/6251399

IF: 2.249

2021-09-15

Journal of Advanced Transportation

Abstract:The multitarget vehicle tracking and motion state estimation are crucial for controlling the host vehicle accurately and preventing collisions. However, current multitarget tracking methods are inconvenient to deal with multivehicle issues due to the dynamically complex driving environment. Driving environment perception systems, as an indispensable component of intelligent vehicles, have the potential to solve this problem from the perspective of image processing. Thus, this study proposes a novel driving environment perception system of intelligent vehicles by using deep learning methods to track multitarget vehicles and estimate their motion states. Firstly, a panoramic segmentation neural network that supports end-to-end training is designed and implemented, which is composed of semantic segmentation and instance segmentation. A depth calculation model of the driving environment is established by adding a depth estimation branch to the feature extraction and fusion module of the panoramic segmentation network. These deep neural networks are trained and tested in the Mapillary Vistas Dataset and the Cityscapes Dataset, and the results showed that these methods performed well with high recognition accuracy. Then, Kalman filtering and Hungarian algorithm are used for the multitarget vehicle tracking and motion state estimation. The effectiveness of this method is tested by a simulation experiment, and results showed that the relative relation (i.e., relative speed and distance) between multiple vehicles can be estimated accurately. The findings of this study can contribute to the development of intelligent vehicles to alert drivers to possible danger, assist drivers’ decision-making, and improve traffic safety.

transportation science & technology,engineering, civil

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in complex dynamic driving environments, existing multi - target vehicle tracking methods are difficult to effectively handle multi - vehicle problems, especially difficult to accurately estimate the relative positions and velocities among multiple vehicles, thus affecting the precise control and collision prevention of intelligent vehicles. To solve these problems, the author proposes a new driving environment perception system based on the visual perception system, using deep - learning methods for multi - target vehicle tracking and motion - state estimation.

Specifically, this research aims to develop a new intelligent vehicle driving environment perception system to achieve multi - target vehicle tracking and the estimation of their motion states. This helps to alert drivers to possible dangers, assist in driver decision - making, and improve traffic safety.

### Main solutions and technical means

1. **Panoramic segmentation neural network**:
- Design and implement a panoramic segmentation neural network that supports end - to - end training, including semantic segmentation and instance segmentation.
- Add a depth - estimation branch in the feature extraction and fusion module to establish a depth - calculation model of the driving environment.

2. **Multi - target vehicle tracking and motion - state estimation**:
- Use Kalman Filtering and the Hungarian Algorithm for multi - target vehicle tracking and motion - state estimation.
- Verify the effectiveness of this method through simulation experiments, and the results show that it can accurately estimate the relative positions and velocities among multiple vehicles.

### Formula representation

- **Depth - estimation formula**:
The depth - estimation task is to find a suitable function \( F \) to map image information to depth information:
\[
D = F(I)
\]
where \( I \) is the input image and \( D \) is the image depth.

- **Kalman - gain formula**:
The Kalman gain \( K \) represents the ratio of the prediction error to the measurement error:
\[
K=\frac{\text{Predicted error}}{\text{Predicted error}+\text{Measurement error}}
\]
where \( K\in[0, 1] \). When \( K = 0 \), it means that the prediction error is 0, and the best state of the detection box completely depends on the predicted value of the model; when \( K = 1 \), it means that the observation error is 0, and the best state of the detection box completely depends on the detection result of the panoramic segmentation system.

Through these technical means, this research provides a more accurate and reliable multi - target vehicle tracking and motion - state estimation method for intelligent vehicles, which helps to improve driving safety and the intelligent level.