Abstract:3D object detection in autonomous driving systems perceives the surrounding environment and is the foundation for autonomous driving. Due to the sparsity inherent in point clouds in autonomous driving scenarios, LiDAR-based 3D object detection often fails to distinguish distant objects effectively. Addressing the issue of point cloud sparsity will enhance the detection range in autonomous driving scenarios. Pseudo point clouds have been used to enhance the ability of deep learning models to detect distant points. However, this approach has several shortcomings. In this paper, a curbed fake point collector (CFPC), which addresses the three issues caused by pseudo points, is proposed to support 3D object detection for autonomous vehicles. First, for noise points with inaccurate coordinates, the dead pixel checker (DPC) calculates the depth map gradient using the Sobel operator. This approach enables the deep learning model to identify noise points. Second, because of the excessive quantity of points, sparse prioritized local sampling (SPLS) reduces the number of input point clouds to a lightweight level that can be accommodated by computing devices with limited memory. This is achieved through grid-based random sampling and real-point-prioritized farthest point sampling. This module effectively samples an appropriate pseudo point cloud based on the density of points in local space. Third, with respect to interference among channels, channel mask set abstraction (CMSA) isolates channels describing different information within the point cloud using GroupMLP, which is an MLP that separates channels into their respective groups. Group separation facilitates the extraction of features without mutual influence, allocating half of the output channels to color information and the other half to geometric information. The effectiveness of our approach is demonstrated by the results of experiments conducted on the KITTI dataset. It is superior to the baseline in most situations, particularly in the categories of cars and riders.

FPPN: Future Pseudo-LiDAR Frame Prediction for Autonomous Driving

RPP-Net: Rigid Constrained Point Cloud Prediction Network

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

An End-to-End Future Frame Prediction Method for Vehicle-Centric Driving Videos

Adaptive Recurrent Frame Prediction with Learnable Motion Vectors.

PointINet: Point Cloud Frame Interpolation Network

Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks

Pseudo-Image and Sparse Points: Vehicle Detection with 2D LiDAR Revisited by Deep Learning-Based Methods

Pseudo-LiDAR Point Cloud Interpolation Based on 3D Motion Representation and Spatial Supervision

CFPC: The Curbed Fake Point Collector to Pseudo-LiDAR-Based 3D Object Detection for Autonomous Vehicles

FSNet: Redesign Self-Supervised MonoDepth for Full-Scale Depth Prediction for Autonomous Driving

Looking-Ahead: Neural Future Video Frame Prediction

ATPPNet: Attention based Temporal Point cloud Prediction Network

FusionMapping: Learning Depth Prediction with Monocular Images and 2D Laser Scans

DenseLiDAR: A Real-Time Pseudo Dense Depth Guided Depth Completion Network

Depth Completion via Inductive Fusion of Planar LIDAR and Monocular Camera

Real-time depth completion based on LiDAR-stereo for autonomous driving

FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field Prediction with Future Context Encoding

Frame Fusion with Vehicle Motion Prediction for 3D Object Detection

BE-STI: Spatial-Temporal Integrated Network for Class-agnostic Motion Prediction with Bidirectional Enhancement

FP-RCNN: A Real-Time 3D Target Detection Model based on Multiple Foreground Point Sampling for Autonomous Driving