Abstract:In the current 3-D object detection tasks, most algorithms are based on pure point cloud. Although LiDAR can provide target location information and contour information for detection, it is sparse, especially for long-distance objects. Besides, camera sensors can provide more detailed target color, texture information, and so on. However, if both point cloud and image data are used for object detection at the same time, the problem of large model capacity and overfitting will occur. Different modes will also produce different gradients for different subnetworks, and the entire network will be difficult to optimize. In order to solve these problems and continuously improve the performance of detection algorithms, this article designs a 3-D object detection method attention mechanism and voxel feature pyramid multimodal VoxelNet (AVFP-MVX), which uses both point cloud and image data to solve the above problems. By referring to MVX-Net, attention mechanism and voxel feature pyramid are used to improve the detection accuracy of 3-D objects. The visualization results show that the overall performance of AVFP-MVX does well, which can accurately select the target object and return to a good bounding box. Comparative tests show that the proposed method detected 91.24%, 80.45%, and 76.91% for the easy, mod, and hard targets of car, respectively, while the average accuracy of pedestrian and cyclist is 62.44% and 67.64%, respectively, which is better than the other methods. The results of ablation experiments show that when the attention mechanism and the voxel feature pyramid network (Voxel-FPN) were added, the detection accuracy of car, pedestrian, and cyclist was increased by 1.87%, 1.85%, and 1.88%, respectively.

PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection

SSF: Sparse Point Cloud Object Detection Based on Self-Adaptive Voxel Encoding and Focal-Sparse Convolution

PV-RCNN++: Semantical Point-Voxel Feature Interaction for 3D Object Detection

P2V-RCNN: Point to Voxel Feature Learning for 3D Object Detection From Point Clouds

Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detection

NV2P-RCNN: Feature Aggregation Based on Voxel Neighborhood for 3D Object Detection

PVConvNet: Pixel-Voxel Sparse Convolution for multimodal 3D object detection

PVT-SSD: Single-Stage 3D Object Detector with Point-Voxel Transformer

Improved Point-Voxel Region Convolutional Neural Network: 3D Object Detectors for Autonomous Driving

Real-Time Point Cloud Object Detection via Voxel-Point Geometry Abstraction

FasterV-RCNN: Efficient Point Cloud 3D Object Detection Framework

AVFP-MVX: Multimodal VoxelNet with Attention Mechanism and Voxel Feature Pyramid

F-PVNet: Frustum-Level 3-D Object Detection on Point–Voxel Feature Representation for Autonomous Driving

PVFE: Point-Voxel Feature Encoders for 3D Object Detection

FRS-Voxel: A 3D-2D Hybrid Feature Extraction Network for 3D Object Detection

3D Object Detector: A Multiscale Region Proposal Network Based on Autonomous Driving.

HPV-RCNN: Hybrid Point–Voxel Two-Stage Network for LiDAR-Based 3-D Object Detection

Voxel Graph Attention for 3-D Object Detection From Point Clouds

DV-Det: Efficient 3D Point Cloud Object Detection with Dynamic Voxelization

PVAFN: Point-Voxel Attention Fusion Network with Multi-Pooling Enhancing for 3D Object Detection

DVFENet: Dual-branch voxel feature extraction network for 3D object detection