Abstract:In the current 3-D object detection tasks, most algorithms are based on pure point cloud. Although LiDAR can provide target location information and contour information for detection, it is sparse, especially for long-distance objects. Besides, camera sensors can provide more detailed target color, texture information, and so on. However, if both point cloud and image data are used for object detection at the same time, the problem of large model capacity and overfitting will occur. Different modes will also produce different gradients for different subnetworks, and the entire network will be difficult to optimize. In order to solve these problems and continuously improve the performance of detection algorithms, this article designs a 3-D object detection method attention mechanism and voxel feature pyramid multimodal VoxelNet (AVFP-MVX), which uses both point cloud and image data to solve the above problems. By referring to MVX-Net, attention mechanism and voxel feature pyramid are used to improve the detection accuracy of 3-D objects. The visualization results show that the overall performance of AVFP-MVX does well, which can accurately select the target object and return to a good bounding box. Comparative tests show that the proposed method detected 91.24%, 80.45%, and 76.91% for the easy, mod, and hard targets of car, respectively, while the average accuracy of pedestrian and cyclist is 62.44% and 67.64%, respectively, which is better than the other methods. The results of ablation experiments show that when the attention mechanism and the voxel feature pyramid network (Voxel-FPN) were added, the detection accuracy of car, pedestrian, and cyclist was increased by 1.87%, 1.85%, and 1.88%, respectively.

PVFE: Point-Voxel Feature Encoders for 3D Object Detection

SSF: Sparse Point Cloud Object Detection Based on Self-Adaptive Voxel Encoding and Focal-Sparse Convolution

PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection

P2V-RCNN: Point to Voxel Feature Learning for 3D Object Detection From Point Clouds

PVT-SSD: Single-Stage 3D Object Detector with Point-Voxel Transformer

PV-RCNN++: Semantical Point-Voxel Feature Interaction for 3D Object Detection

Two-stage 3D Object Detection Guided by Position Encoding

Voxel or Pillar: Exploring Efficient Point Cloud Representation for 3D Object Detection

F-PVNet: Frustum-Level 3-D Object Detection on Point–Voxel Feature Representation for Autonomous Driving

VPFusion: Towards Robust Vertical Representation Learning for 3D Object Detection.

PVGNet: A Bottom-Up One-Stage 3D Object Detector with Integrated Multi-Level Features

DVFENet: Dual-branch voxel feature extraction network for 3D object detection

FVNet: 3D Front-View Proposal Generation for Real-Time Object Detection from Point Clouds

PointFPN: A Frustum-based Feature Pyramid Network for 3D Object Detection

Point-Voxel Fusion for 3D Object Detection

CVPCG: Centrosymmetric Virtual Point Cloud Generation for 3D Object Detection

AVFP-MVX: Multimodal VoxelNet with Attention Mechanism and Voxel Feature Pyramid

PVAFN: Point-Voxel Attention Fusion Network with Multi-Pooling Enhancing for 3D Object Detection

PVConvNet: Pixel-Voxel Sparse Convolution for multimodal 3D object detection

FRS-Voxel: A 3D-2D Hybrid Feature Extraction Network for 3D Object Detection

Murf-Net: Multi-Receptive Field Pillars For 3d Object Detection From Point Cloud