Abstract:Recent vision-only perception models for autonomous driving achieved promising results by encoding multi-view image features into Bird's-Eye-View (BEV) space. A critical step and the main bottleneck of these methods is transforming image features into the BEV coordinate frame. This paper focuses on leveraging geometry information, such as depth, to model such feature transformation. Existing works rely on non-parametric depth distribution modeling leading to significant memory consumption, or ignore the geometry information to address this problem. In contrast, we propose to use parametric depth distribution modeling for feature transformation. We first lift the 2D image features to the 3D space defined for the ego vehicle via a predicted parametric depth distribution for each pixel in each view. Then, we aggregate the 3D feature volume based on the 3D space occupancy derived from depth to the BEV frame. Finally, we use the transformed features for downstream tasks such as object detection and semantic segmentation. Existing semantic segmentation methods do also suffer from an hallucination problem as they do not take visibility information into account. This hallucination can be particularly problematic for subsequent modules such as control and planning. To mitigate the issue, our method provides depth uncertainty and reliable visibility-aware estimations. We further leverage our parametric depth modeling to present a novel visibility-aware evaluation metric that, when taken into account, can mitigate the hallucination problem. Extensive experiments on object detection and semantic segmentation on the nuScenes datasets demonstrate that our method outperforms existing methods on both tasks.

A Bird-View Solution for Parking Assistance Based on Scene Classification

Automatic Parking Based on a Bird's Eye View Vision System

3-D Surround View for Advanced Driver Assistance Systems.

Intelligent Driver Assistance System Based on Panoramic Video Technique

A Parking Trajectory Planning Method Based on Geometric Constraints

Capture Of Vehicle Surroundings Using A Pair Of Panoramic Annular Lens Cameras

Parking Spot Classification based on surround view camera system

Research on Automatic Parking Systems Based on Parking Scene Recognition

A Practical Panorama Parking Assistant System Based on Image Splicing

Moving Object Detection Using an In-Vehicle Fish-Eye Camera

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

Deep-Learning-Based Parking Area and Collision Risk Area Detection Using AVM in Autonomous Parking Situation

Assistant-Parking System Based on Vision Perception System and Fuzzy Logic Controller

Around-View-Monitoring-Based Automatic Parking System Using Parking Line Detection

Visual Detection and Image Processing of Parking Space Based on Deep Learning

A vision-based method for parking space surveillance and parking lot management

Automated Parking Planning with Vision-Based BEV Approach

Enhanced Parking Perception by Multi-Task Fisheye Cross-view Transformers

Parametric Depth Based Feature Representation Learning for Object Detection and Segmentation in Bird's Eye View

Smart Camera Parking System With Auto Parking Spot Detection

Computer Vision Based Parking Optimization System