Abstract:Ensuring adherence to traffic sign regulations is essential for both human and autonomous vehicle navigation. While current benchmark datasets concentrate on lane perception or basic traffic sign recognition, they often overlook the intricate task of integrating these regulations into lane operations. Addressing this gap, we introduce MapDR, a novel dataset designed for the extraction of Driving Rules from traffic signs and their association with vectorized, locally perceived HD Maps. MapDR features over 10,000 annotated video clips that capture the intricate correlation between traffic sign regulations and lanes. We define two pivotal sub-tasks: 1) Rule Extraction from Traffic Sign, which accurately deciphers regulatory instructions, and 2) Rule-Lane Correspondence Reasoning, which aligns these rules with their respective lanes. Built upon this benchmark, we provide a multimodal solution that offers a strong baseline for advancing autonomous driving technologies. It fills a critical gap in the integration of traffic sign rules, contributing to the development of reliable autonomous navigation systems.
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to effectively integrate traffic sign rules with lane operations to ensure that both human - driven and self - driving vehicles can abide by traffic sign regulations. Specifically, the paper points out that current benchmark datasets mainly focus on lane perception or basic traffic sign recognition, while ignoring the complex task of integrating these rules into lane operations.
To fill this gap, the authors introduce a new dataset named MapDR, which aims to extract driving rules from traffic signs and associate them with lanes in vectorized high - definition maps (HD Map). The MapDR dataset contains more than 10,000 annotated video clips, capturing the complex associations between traffic sign rules and lanes.
The paper defines two key subtasks:
1. **Rule extraction from traffic signs**: Accurately interpret the regulatory instructions on traffic signs.
2. **Rule - lane correspondence reasoning**: Align these rules with their corresponding lanes.
Based on this benchmark, the authors provide a multimodal solution, providing a strong baseline for advancing self - driving technology. In this way, the paper fills a crucial gap in traffic sign rule integration, which is helpful for developing reliable self - driving navigation systems.
### Formula representation
The paper does not involve complex mathematical formulas, but for the sake of completeness of the answer, the following are some key formulas for evaluating model performance:
#### Rule extraction (R.E.)
Given the ground truth \( R \) and the predicted rule \( \hat{R} \), calculate precision (Precision) and recall rate (Recall):
\[
P_{R.E.} = \frac{| \hat{R} \cap R |}{| \hat{R} |}, \quad R_{R.E.} = \frac{| \hat{R} \cap R |}{| R |}
\]
#### Correspondence reasoning (C.R.)
Given the real bipartite graph \( G=(R \cup L, E) \) and the predicted bipartite graph \( \hat{G}=(R \cup L, \hat{E}) \), calculate the precision (Precision) and recall rate (Recall) of the edge set \( E \):
\[
P_{C.R.} = \frac{| \hat{E} \cap E |}{| \hat{E} |}, \quad R_{C.R.} = \frac{| \hat{E} \cap E |}{| E |}
\]
#### Overall evaluation
Comprehensively evaluate the capabilities of the two subtasks, calculate the overall precision (Precision) and recall rate (Recall), and use the average precision (AP) for the final ranking:
\[
P_{all} = \frac{| \hat{G_s} \cap G_s |}{| \hat{G_s} |}, \quad R_{all} = \frac{| \hat{G_s} \cap G_s |}{| G_s |}, \quad AP = \int_0^1 p(r) \, dr
\]
where \( p \) and \( r \) represent \( P_{all} \) and \( R_{all} \) respectively.
Through these methods, the paper provides an important foundation and direction for research in the field of self - driving.