Abstract:As Light Detection And Ranging (LiDAR) increasingly becomes an essential component in robotic navigation and autonomous driving, the processing of high throughput 3D point clouds in real time is widely required. This work considers the point cloud k-Nearest Neighbor (kNN) search, which is an important 3D processing kernel. Although applying fine-grained parallelism optimization on internal processing, e.g., using multiple workers, has demonstrated high efficiency, previous accelerators with DDR external memory are fundamentally limited by the external bandwidth bottleneck. To break this bottleneck, this work proposes a highly parallel architecture, namely ParallelNN, for highly efficient kNN search processing of high throughput point clouds. First, we optimize the multichannel cache based on High Bandwidth Memory (HBM) and on-chip memory to provide large external bandwidth. Then, a novel parallel depth-first octree construction algorithm is proposed and mapped onto multiple construction branches with trace-coded construction queues, which can regularize random accesses and perform multi-branch octree construction efficiently. Furthermore, in the search stage, we present algorithm-architecture co-optimization, including parallel keyframe-based scheduling and multi-branch flexible search engines, to provide conflict-free access and maximum reuse opportunities for reference points, which achieves more than 27.0× speedup compared with baseline architectures. We prototype ParallelNN on Virtex HBM FPGA and perform extensive benchmarking on the KITTI dataset. The results demonstrate that ParallelNN achieves up to 107.7× and 12.1× speedup over CPU and GPU implementations, while being more energy efficient, e.g., outperforming CPU and GPU implementations by 73.6× and 31.1×, respectively. Besides, with the proposed algorithm-architecture co-optimization, ParallelNN achieves 11.4× speedup over state-of-the-art architecture. Moreover, ParallelNN is configurable and can be easily generalized to similar octree-based applications.

A New K-Nearest Neighbors Search Algorithm Based on 3D Cell Grids

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

Constrained All-k-Nearest-Neighbor Search

A Grid-Based Density Peaks Clustering Algorithm

Grid Interpolation Algorithm Based on Nearest Neighbor Fast Search

Efficient Nearest Neighbor Search Using Dynamic Programming

Study on a nearest neighbor algorithm for point clouds based on the space partition principle

A Novel Approach to the Extraction of Key Points from 3-D Rigid Point Cloud Using 2-D Images Transformation

Surface Extraction and Boundary Detection Based on DBSCAN Clustering in 3D Point Clouds

A Nearest Neighbor Searches(NNS) Algorithm for Fast Registration of 3D Point Clouds Based on GPGPU

Large Scale Nearest Neighbors Search Based on Neighborhood Graph.

Adaptive deep learning-based neighborhood search method for point cloud

An Algorithm for Mobile Robot Path Planning Based on 3D Grid Map

A New Subspace Clustering Algorithm

K-nearest Neighbor Query Algorithm in Spatio-temporal Databases

Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis

2L-LSH: A Locality-Sensitive Hash Function-Based Method For Rapid Point Cloud Indexing

A New Hashing based Nearest Neighbors Selection Technique for Big Datasets

ParallelNN: A Parallel Octree-based Nearest Neighbor Search Accelerator for 3D Point Clouds

Mean Reverse Shift Query Algorithm for Topological Neighbors of Scattered Point-cloud

Multiple-Level Grid Algorithm For Getting 2d Road Map In 3d Virtual Scene