Abstract:The application of vision-based multi-view environmental perception system has been increasingly recognized in autonomous driving technology, especially the BEV-based models. Current state-of-the-art solutions primarily encode image features from each camera view into the BEV space through explicit or implicit depth prediction. However, these methods often focus on improving the accuracy of projecting 2D features into corresponding depth regions, while overlooking the highly structured information of real-world objects and the varying height distributions of objects across different scenes. In this work, we propose HV-BEV, a novel approach that decouples feature sampling in the BEV grid queries paradigm into horizontal feature aggregation and vertical adaptive height-aware reference point sampling, aiming to improve both the aggregation of objects' complete information and generalization to diverse road environments. Specifically, we construct a learnable graph structure in the horizontal plane aligned with the ground for 3D reference points, reinforcing the association of the same instance across different BEV grids, especially when the instance spans multiple image views around the vehicle. Additionally, instead of relying on uniform sampling within a fixed height range, we introduce a height-aware module that incorporates historical information, enabling the reference points to adaptively focus on the varying heights at which objects appear in different scenes. Extensive experiments validate the effectiveness of our proposed method, demonstrating its superior performance over the baseline across the nuScenes dataset. Moreover, our best-performing model achieves a remarkable 50.5% mAP and 59.8% NDS on the nuScenes testing set.

BEV feature exchange pyramid networks-based 3D object detection in small and distant situations: A decentralized federated learning framework

A Streamlined Framework for Bev-Based 3d Object Detection with Prior Masking

FSD-BEV: Foreground Self-Distillation for Multi-view 3D Object Detection

BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-View

HV-BEV: Decoupling Horizontal and Vertical Feature Sampling for Multi-View 3D Object Detection

Towards Efficient 3D Object Detection in Bird's-Eye-View Space for Autonomous Driving: A Convolutional-Only Approach

OCBEV: Object-Centric BEV Transformer for Multi-View 3D Object Detection

3D Object Detection for Point Cloud in Virtual Driving Environment

EFNet: enhancing feature information for 3D object detection in LiDAR point clouds

A Versatile Multi-View Framework for LiDAR-based 3D Object Detection with Guidance from Panoptic Segmentation

BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection

SimpleBEV: Improved LiDAR-Camera Fusion Architecture for 3D Object Detection

DeployFusion: A Deployable Monocular 3D Object Detection with Multi-Sensor Information Fusion in BEV for Edge Devices

Delving into the Secrets of BEV 3D Object Detection in Autonomous Driving: A Comprehensive Survey

PreBEV: Leveraging Predictive Flow for Enhanced Bird's-Eye View 3D Dynamic Object Detection

OA-BEV: Bringing Object Awareness to Bird's-Eye-View Representation for Multi-Camera 3D Object Detection

On the Federated Learning Framework for Cooperative Perception

Monocular 3D Object Detection with Motion Feature Distillation.

BEV-MAE: Bird's Eye View Masked Autoencoders for Point Cloud Pre-training in Autonomous Driving Scenarios

Sparse Federated Training of Object Detection in the Internet of Vehicles