Abstract:In autonomous driving, lidar has become the main vehicle sensor due to its advantages such as long-range measurement and high accuracy. However, the collected point cloud data is sparse and unevenly distributed, and it lacks characterization capabilities when facing objects with missing or similar shapes, so that the detection accuracy is low while detecting long-distance small targets with similar shapes and a small number of point clouds. In order to improve the detection accuracy of small targets represented by point clouds, this paper adopts a method that fuses point cloud and RGB image to construct a 3D object detection network architecture based on two-stage complementary fusion. In the first stage of the fusion, we use the FPS method to select some points from the raw point cloud data as key points. Then, we voxelize the raw point cloud and use the 3D sparse convolutional neural network to extract multi-scale points cloud features, which would fuse features of different scales with key points. In the second stage of fusion, a 2D object detector is used to obtain the 2D bounding box and category information of the target in the image and take the camera as the origin to extend along the direction of the 2D bounding box to form a frustum; then the point cloud and target category information within the frustum are fused into the key points. This paper uses key points as a bridge to effectively combine the semantic information of the image such as texture and color with the point cloud features. The experimental results show that the network proposed in this paper has excellent performance on small objects.

A Real-Time Vehicle Detection Algorithm Based on Sparse Point Clouds and Dempster-Shafer Fusion Theory

Pseudo-Image and Sparse Points: Vehicle Detection with 2D LiDAR Revisited by Deep Learning-Based Methods

Real-Time Vehicle Detection Framework Based on the Fusion of LiDAR and Camera

Real-time Vehicle Detection and Distance Measurement in Multi-Environment

Research On Multi-Feature Front Vehicle Detection Algorithm Based On Video Image

3-D Vehicle Detection Enhancement Using Tracking Feedback in Sparse Point Clouds Environments

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

Embedded and Real-Time Vehicle Detection System for Challenging On-Road Scenes

3D Dynamic Multi-target Detection Algorithm Based on Cross-view Feature Fusion

Research on 3D Point Cloud Object Detection Algorithm for Autonomous Driving

Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation

Object Detection Based on Fusion of Sparse Point Cloud and Image Information

Vehicle Detection and Shape Refinement Based on LiDAR

3D Fast Object Detection Based on Discriminant Images and Dynamic Distance Threshold Clustering

A Two-Stage Clustering Method for Point Clouds Based on Cooperative Perception of Vehicle-to-Vehicle

A Novel Point Cloud Clustering Algorithm Integrating In-Vehicle Driver Monitoring

Vehicle Detection Based on Point Cloud Intensity and Distance Clustering

Detection and Tracking Dynamic Vehicles for Autonomous Driving Based on 2-D Point Scans.

Lidar object real-time detection method under complex environment

3D Point Cloud Object Detection Method Based on Multi-Scale Dynamic Sparse Voxelization

Real-Time Road Intersection Detection in Sparse Point Cloud Based on Augmented Viewpoints Beam Model