Abstract:Bird's eye view (BEV) semantic maps have evolved into a crucial element of urban intelligent traffic management and monitoring, offering invaluable visual and significant data representations for informed intelligent city decision making. Nevertheless, current methodologies continue underutilizing the temporal information embedded within dynamic frames throughout the BEV feature transformation process. This limitation results in decreased accuracy when mapping high-speed moving objects, particularly in capturing their shape and dynamic trajectory. A framework is proposed for cross-view semantic segmentation to address this challenge, leveraging simulated environments as a starting point before applying it to real-life urban imaginative transportation scenarios. The view converter module is thoughtfully designed to collate information from multiple initial view observations captured from various angles and modes. This module outputs a top-down view semantic graph characterized by its object space layout to preserve beneficial temporal information in BEV transformation. The NuScenes dataset is used to evaluate model effectiveness. A novel application is also devised that harnesses transformer networks to map images and video sequences into top-down or comprehensive bird's-eye views. By combining physics-based and constraint-based formulations and conducting ablation studies, the approach has been substantiated, highlighting the significance of context above and below a given point in generating these maps. This innovative method has been thoroughly validated on the NuScenes dataset. Notably, it has yielded state-of-the-art instantaneous mapping results, with particular benefits observed for smaller dynamic category displays. The experimental findings include comparing axial attention with the state-of-the-art (SOTA) model, demonstrating the performance enhancement associated with temporal awareness.

Obstacle-sensitive Semantic Bird-Eye-View Map Generation with Boundary-aware Loss for Autonomous Driving

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

S2G2: Semi-Supervised Semantic Bird-Eye-View Grid-Map Generation Using a Monocular Camera for Autonomous Driving

BLOS-BEV: Navigation Map Enhanced Lane Segmentation Network, Beyond Line of Sight

Bi-Mapper: Holistic BEV Semantic Mapping for Autonomous Driving

OE-BevSeg: An Object Informed and Environment Aware Multimodal Framework for Bird's-eye-view Vehicle Semantic Segmentation

SA-BEV: Generating Semantic-Aware Bird's-Eye-View Feature for Multi-view 3D Object Detection

Vision-Driven 2D Supervised Fine-Tuning Framework for Bird's Eye View Perception

Predicting Maps Using In-Vehicle Cameras for Data-Driven Intelligent Transport

Improving Bird's Eye View Semantic Segmentation by Task Decomposition

M-BEV: Masked BEV Perception for Robust Autonomous Driving

Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Driving

Improving Bird’s Eye View Semantic Segmentation by Task Decomposition

Towards Efficient 3D Object Detection in Bird's-Eye-View Space for Autonomous Driving: A Convolutional-Only Approach

Understanding Bird's-Eye View of Road Semantics using an Onboard Camera

BEVal: A Cross-dataset Evaluation Study of BEV Segmentation Models for Autonomous Driving

MapVision: CVPR 2024 Autonomous Grand Challenge Mapless Driving Tech Report

BEV-Seg: Bird's Eye View Semantic Segmentation Using Geometry and Semantic Point Cloud

BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layout