Abstract:The multi-line LiDAR is widely used in autonomous vehicles, so point cloud-based 3D detectors are essential for autonomous driving. Extracting rich multi-scale features is crucial for point cloud-based 3D detectors in autonomous driving due to significant differences in the size of different types of objects. However, because of the real-time requirements, large-size convolution kernels are rarely used to extract large-scale features in the backbone. Current 3D detectors commonly use feature pyramid networks to obtain large-scale features; however, some objects containing fewer point clouds are further lost during down-sampling, resulting in degraded performance. Since pillar-based schemes require much less computation than voxel-based schemes, they are more suitable for constructing real-time 3D detectors. Hence, we propose the PillarNeXt, a pillar-based scheme. We redesigned the feature encoding, the backbone, and the neck of the 3D detector. We propose the Voxel2Pillar feature encoding, which uses a sparse convolution constructor to construct pillars with richer point cloud features, especially height features. The Voxel2Pillar adds more learnable parameters to the feature encoding, enabling the initial pillars to have higher performance ability. We extract multi-scale and large-scale features in the proposed fully sparse backbone, which does not utilize large-size convolutional kernels; the backbone consists of the proposed multi-scale feature extraction module. The neck consists of the proposed sparse ConvNeXt, whose simple structure significantly improves the performance. We validate the effectiveness of the proposed PillarNeXt on the Waymo Open Dataset, and the object detection accuracy for vehicles, pedestrians, and cyclists is improved. We also verify the effectiveness of each proposed module in detail through ablation studies.

ScorePillar: A Real-Time Small Object Detection Method Based on Pillar Scoring of Lidar Measurement

Fusing LiDAR and Radar with Pillars Attention for 3D Object Detection

HybridPillars: Hybrid Point-Pillar Network for Real-time Two-stage 3D Object Detection

Improved Pillar with Fine-grained Feature for 3D Object Detection

PEPillar: a point-enhanced pillar network for efficient 3D object detection in autonomous driving

A Study on 3D LiDAR-based Point Cloud Object Detection using an Enhanced PointPillars Network

Pillar-based multilayer pseudo-image 3D object detection

PillarNet++: Pillar-Based 3-D Object Detection with Multiattention

SwiftPillars: High-Efficiency Pillar Encoder for Lidar-Based 3D Detection

PillarBAPI: Enhancing Pillar-Based 3D Object Detection Through Attentive Pseudo-Image Feature Extraction

Pillar-Based 3D Object Detection from Point Cloud with Multiattention Mechanism

ET-PointPillars: improved PointPillars for 3D object detection based on optimized voxel downsampling

PillarNet: Real-Time and High-Performance Pillar-Based 3D Object Detection

PillarNeXt: Improving the 3D detector by introducing Voxel2Pillar feature encoding and extracting multi-scale features

Scale-Aware Attention-Based PillarsNet (SAPN) Based 3D Object Detection for Point Cloud

PillarNeXt: Rethinking Network Designs for 3D Object Detection in LiDAR Point Clouds

FastPillars: A Deployment-friendly Pillar-based 3D Detector

PillarTrack: Redesigning Pillar-based Transformer Network for Single Object Tracking on Point Clouds

3D Point Cloud Object Detection Method Based on Multi-Scale Dynamic Sparse Voxelization

A LiDAR Multi-Object Detection Algorithm for Autonomous Driving

Accurate and Real-Time 3D Pedestrian Detection Using an Efficient Attentive Pillar Network