Abstract:Achieving the accurate perception of occluded objects for autonomous vehicles is a challenging problem. Human vision can always quickly locate important object regions in complex external scenes, while other regions are only roughly analysed or ignored, defined as the visual attention mechanism. However, the perception system of autonomous vehicles cannot know which part of the point cloud is in the region of interest. Therefore, it is meaningful to explore how to use the visual attention mechanism in the perception system of autonomous driving. In this paper, we propose the model of the spatial attention frustum to solve object occlusion in 3D object detection. The spatial attention frustum can suppress unimportant features and allocate limited neural computing resources to critical parts of the scene, thereby providing greater relevance and easier processing for higher-level perceptual reasoning tasks. To ensure that our method maintains good reasoning ability when faced with occluded objects with only a partial structure, we propose a local feature aggregation module to capture more complex local features of the point cloud. Finally, we discuss the projection constraint relationship between the 3D bounding box and the 2D bounding box and propose a joint anchor box projection loss function, which will help to improve the overall performance of our method. The results of the KITTI dataset show that our proposed method can effectively improve the detection accuracy of occluded objects. Our method achieves 89.46%, 79.91% and 75.53% detection accuracy in the easy, moderate, and hard difficulty levels of the car category, and achieves a 6.97% performance improvement especially in the hard category with a high degree of occlusion. Our one-stage method does not need to rely on another refining stage, comparable to the accuracy of the two-stage method.

FGR: Frustum-Aware Geometric Reasoning for Weakly Supervised 3D Vehicle Detection

Robust vehicle detection using 3D Lidar under complex urban environment

Spatial Attention Frustum: A 3D Object Detection Method Focusing on Occluded Objects

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

Image Guidance Based 3D Vehicle Detection in Traffic Scene.

General Geometry-aware Weakly Supervised 3D Object Detection

3D Bounding Box Estimation for Autonomous Vehicles by Cascaded Geometric Constraints and Depurated 2D Detections Using 3D Results

3D Vehicle Detection Using Cheap LiDAR and Camera Sensors.

3D Detection for Occluded Vehicles From Point Clouds

Frustum PointNets for 3D Object Detection from RGB-D Data

F-PVNet: Frustum-Level 3-D Object Detection on Point–Voxel Feature Representation for Autonomous Driving

Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation

Far3Det: Towards Far-Field 3D Detection

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

Joint Monocular 3D Vehicle Detection and Tracking

Monocular Vehicle 3D Bounding Box Estimation Using Homograhy and Geometry in Traffic Scene

An Efficient Wide-Range Pseudo-3D Vehicle Detection Using A Single Camera

SGV3D:Towards Scenario Generalization for Vision-based Roadside 3D Object Detection

Weakly Supervised 3D Object Detection via Multi-Level Visual Guidance

SGFNet: Segmentation Guided Fusion Network for 3D Object Detection.

3D object detection algorithm based on multi-sensor segmental fusion of frustum association for autonomous driving