Abstract:Achieving the accurate perception of occluded objects for autonomous vehicles is a challenging problem. Human vision can always quickly locate important object regions in complex external scenes, while other regions are only roughly analysed or ignored, defined as the visual attention mechanism. However, the perception system of autonomous vehicles cannot know which part of the point cloud is in the region of interest. Therefore, it is meaningful to explore how to use the visual attention mechanism in the perception system of autonomous driving. In this paper, we propose the model of the spatial attention frustum to solve object occlusion in 3D object detection. The spatial attention frustum can suppress unimportant features and allocate limited neural computing resources to critical parts of the scene, thereby providing greater relevance and easier processing for higher-level perceptual reasoning tasks. To ensure that our method maintains good reasoning ability when faced with occluded objects with only a partial structure, we propose a local feature aggregation module to capture more complex local features of the point cloud. Finally, we discuss the projection constraint relationship between the 3D bounding box and the 2D bounding box and propose a joint anchor box projection loss function, which will help to improve the overall performance of our method. The results of the KITTI dataset show that our proposed method can effectively improve the detection accuracy of occluded objects. Our method achieves 89.46%, 79.91% and 75.53% detection accuracy in the easy, moderate, and hard difficulty levels of the car category, and achieves a 6.97% performance improvement especially in the hard category with a high degree of occlusion. Our one-stage method does not need to rely on another refining stage, comparable to the accuracy of the two-stage method.

Leveraging Front and Side Cues for Occlusion Handling in Monocular 3D Object Detection

Enhancing Monocular 3D Object Detection with Occlusion Compensation

Monocular 3D Object Detection Based on Occlusion Optimization

Occlusion Are Underrated: an Occlusion-Attention Strategy Assembled in 3D Object Detectors

Neighbor-Vote: Improving Monocular 3D Object Detection through Neighbor Distance Voting

Occlusion-Aware Plane-Constraints for Monocular 3D Object Detection

Monocular 3D Detection for Autonomous Vehicles by Cascaded Geometric Constraints and Depurated Using 3D Results

Monocular 3D object detection via estimation of paired keypoints for autonomous driving

Shape-Aware Monocular 3D Object Detection

MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationships

Visibility of Points: Mining Occlusion Cues for Monocular 3D Object Detection

Monocular 3D object detection using dual quadric for autonomous driving

MonoAux: Fully Exploiting Auxiliary Information and Uncertainty for Monocular 3D Object Detection

Accurate Monocular Object Detection via Color-Embedded 3D Reconstruction for Autonomous Driving

ABC: Aligning Binary Centers for Single-Stage Monocular 3D Object Detection

3D Detection for Occluded Vehicles From Point Clouds

Accurate Monocular 3D Object Detection Via Color-Embedded 3D Reconstruction for Autonomous Driving.

Depth Dynamic Center Difference Convolutions for Monocular 3D Object Detection.

Context-Aware 3D Object Detection from a Single Image in Autonomous Driving.

Spatial Attention Frustum: A 3D Object Detection Method Focusing on Occluded Objects

Monocular 3D Object Detection With Sequential Feature Association and Depth Hint Augmentation