Abstract:Achieving the accurate perception of occluded objects for autonomous vehicles is a challenging problem. Human vision can always quickly locate important object regions in complex external scenes, while other regions are only roughly analysed or ignored, defined as the visual attention mechanism. However, the perception system of autonomous vehicles cannot know which part of the point cloud is in the region of interest. Therefore, it is meaningful to explore how to use the visual attention mechanism in the perception system of autonomous driving. In this paper, we propose the model of the spatial attention frustum to solve object occlusion in 3D object detection. The spatial attention frustum can suppress unimportant features and allocate limited neural computing resources to critical parts of the scene, thereby providing greater relevance and easier processing for higher-level perceptual reasoning tasks. To ensure that our method maintains good reasoning ability when faced with occluded objects with only a partial structure, we propose a local feature aggregation module to capture more complex local features of the point cloud. Finally, we discuss the projection constraint relationship between the 3D bounding box and the 2D bounding box and propose a joint anchor box projection loss function, which will help to improve the overall performance of our method. The results of the KITTI dataset show that our proposed method can effectively improve the detection accuracy of occluded objects. Our method achieves 89.46%, 79.91% and 75.53% detection accuracy in the easy, moderate, and hard difficulty levels of the car category, and achieves a 6.97% performance improvement especially in the hard category with a high degree of occlusion. Our one-stage method does not need to rely on another refining stage, comparable to the accuracy of the two-stage method.

A Novel Method for Detecting Occluded Object by Multiple Camera Arrays.

Leveraging Front and Side Cues for Occlusion Handling in Monocular 3D Object Detection

A Novel Method For Real-Time Object Detection And Multiple Persons Tracking

Occlusion-Aware Plane-Constraints for Monocular 3D Object Detection

A Top-View Multiple People Tracking System Based on Newest YOLOv5 and DeepSort Using Depth Data

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

New method of multiple object tracking under circumstance of occlusion

An Anti-Occlusion Algorithm for Object Tracking

Seeing Through Obstructions with Diffractive Cloaking

Tracking-Assisted Object Detection with Event Cameras

DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries

Spatial Attention Frustum: A 3D Object Detection Method Focusing on Occluded Objects

Deep Occlusion Reasoning for Multi-camera Multi-target Detection

2-D Direction Finding Using Parallel Nested Arrays with Full Co-Array Aperture Extension.

Finding Multiple Object Instances with Occlusion

A Simple Baseline for Multi-Camera 3D Object Detection

Real-time Detection Via Homography Mapping of Foreground Polygons from Multiple Cameras.

Robust Object Detection with Real-Time Fusion of Multiview Foreground Silhouettes

Parallel Cascade R-CNN for Object Detection in Remote Sensing Imagery

A Novel Wide-Area Multiobject Detection System with High-Probability Region Searching

Synthetic aperture based on plenoptic cameras for seeing behind occlusion