Abstract:Autonomous driving requires a structured understanding of the surrounding road maps and networks to navigate. However, considering the flexibility of autonomous vehicles and the variations in lane curvature and shape, the online and accurate extraction of road maps with fine-grained boundaries and road networks with lane topology in a unified framework remains challenging. This paper proposes SRSU, an online road map detection and network estimation framework for structured bird's-eye view road scene understanding. Specifically, we introduce a hierarchical map representation, i.e. , representing the road map as a set of ordered point sets with equivalent permutations and the road network as a directed graph, accurately describing the fine-grained map boundaries and lane topology in a unified framework. Building upon the above representation, we propose an online hierarchical map construction framework. It utilizes two sets of learnable hierarchical query embeddings to extract road maps with fine-grained boundaries and road networks with lane topologies, achieving a comprehensive understanding of the road scene. Furthermore, we introduce three empirical modules to enhance the accuracy of hierarchical map construction. These modules are termed auxiliary task prediction, multi-modal distillation, and higher-order interaction, responsible for enhancing the model's representational capabilities and providing valuable auxiliary information for subsequent tasks, generating robust features for final tasks, and learning the association information between different tasks, respectively. Finally, experiments on the nuScenes dataset demonstrate the proposed framework's effectiveness while highlighting the empirical module's superiority. Code will be available at https://github.com/jiapeng789/SRSU .

Geometric and Semantic Analysis of Road Image Sequences for Traffic Scene Construction

Spatiotemporal Analysis of Static and Dynamic Traffic Elements from Road Scenes.

Semantic Segmentation and Scene Reconstruction for Traffic Simulation Using CNN

&Lt;title>automatic Traffic Real-Time Analysis System Based on Video</title>

Road Scene Layout Reconstruction Based on CNN and Its Application in Traffic Simulation.

Real-time Semantic Segmentation in Traffic Scene Using Cross Stage Partial-based Encoder–decoder Network

Three-Dimensional Traffic Scenes Simulation from Road Image Sequences

Caption Generation from Road Images for Traffic Scene Construction

A new segmentation method for image sequence of traffic scenes

Multi-model Traffic Scene Simulation with Road Image Sequences and GIS Information

Traffic scene recognition based on deep cnn and vlad spatial pyramids

Rse-net: Road-shape enhanced neural network for Road extraction in high resolution remote sensing image

Fast Semantic Segmentation for Scene Perception

Automatic extraction and 3D modeling of real road scenes using UAV imagery and deep learning semantic segmentation

Road Scene Simulation Based on Vehicle Sensors: an Intelligent Framework Using Random Walk Detection and Scene Stage Reconstruction.

SRSU: an Online Road Map Detection and Network Estimation for Structured Bird's-Eye View Road Scene Understanding

ABSSNet: Attention-Based Spatial Segmentation Network for Traffic Scene Understanding

Real-time Semantic Segmentation for Road Scene

Jointly Detecting and Retrieving Vehicles from Road Image Sequences Based on CNN.

Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene.

3D Traffic Scenes Construction and Simulation Based on Scene Stages