Abstract:In order to accurately identify occluding targets and infer the motion state of objects, we propose a Bird's-Eye View Object Detection Network based on Temporal-Spatial feature fusion (TS-BEV), which replaces the previous multi-frame sampling method by using the cyclic propagation mode of historical frame instance information. We design a new Temporal-Spatial feature fusion attention module, which fully integrates temporal information and spatial features, and improves the inference and training speed. In response to realize multi-frame feature fusion across multiple scales and views, we propose an efficient Temporal-Spatial deformable aggregation module, which performs feature sampling and weighted summation from multiple feature maps of historical frames and current frames, and makes full use of the parallel computing capabilities of GPUs and AI chips to further improve efficiency. Furthermore, in order to solve the lack of global inference in the context of temporal-spatial fusion BEV features and the inability of instance features distributed in different locations to fully interact, we further design the BEV self-attention mechanism module to perform global operation of features, enhance global inference ability and fully interact with instance features. We have carried out extensive experimental experiments on the challenging BEV object detection nuScenes dataset, quantitative results show that our method achieves excellent performance of 61.5% mAP and 68.5% NDS in camera-only 3D object detection tasks, and qualitative results show that TS-BEV can effectively solve the problem of 3D object detection in complex traffic background with lack of light at night, with good robustness and scalability.

TSC-BEV: Temporal-Spatial Feature Consistency 3D Object Detection

TS-BEV: BEV object detection algorithm based on temporal-spatial feature fusion

LiDAR-Based 3D Temporal Object Detection via Motion-Aware LiDAR Feature Fusion

Enhanced 3D object detection for autonomous driving: A spatial-temporal alignment approach in Bird's Eye View scenarios

OCBEV: Object-Centric BEV Transformer for Multi-View 3D Object Detection

Eliminating Cross-modal Conflicts in BEV Space for LiDAR-Camera 3D Object Detection

BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detection

Monocular 3D Object Detection with Motion Feature Distillation.

Query-based Temporal Fusion with Explicit Motion for 3D Object Detection

Multi-sensor Fusion 3D Object Detection Based on Channel Attention

BEVStereo++: Accurate Depth Estimation in Multi-view 3D Object Detection via Dynamic Temporal Stereo

BEVStereo: Enhancing Depth Estimation in Multi-view 3D Object Detection with Dynamic Temporal Stereo

MambaDETR: Query-based Temporal Modeling using State Space Model for Multi-View 3D Object Detection

FSD-BEV: Foreground Self-Distillation for Multi-view 3D Object Detection

A Versatile Multi-View Framework for LiDAR-based 3D Object Detection with Guidance from Panoptic Segmentation

SimpleBEV: Improved LiDAR-Camera Fusion Architecture for 3D Object Detection

MambaBEV: An efficient 3D detection model with Mamba2

BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers

Towards Efficient 3D Object Detection in Bird's-Eye-View Space for Autonomous Driving: A Convolutional-Only Approach

Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perception