Abstract:As Light Detection And Ranging (LiDAR) increasingly becomes an essential component in robotic navigation and autonomous driving, the processing of high throughput 3D point clouds in real time is widely required. This work considers the point cloud k-Nearest Neighbor (kNN) search, which is an important 3D processing kernel. Although applying fine-grained parallelism optimization on internal processing, e.g., using multiple workers, has demonstrated high efficiency, previous accelerators with DDR external memory are fundamentally limited by the external bandwidth bottleneck. To break this bottleneck, this work proposes a highly parallel architecture, namely ParallelNN, for highly efficient kNN search processing of high throughput point clouds. First, we optimize the multichannel cache based on High Bandwidth Memory (HBM) and on-chip memory to provide large external bandwidth. Then, a novel parallel depth-first octree construction algorithm is proposed and mapped onto multiple construction branches with trace-coded construction queues, which can regularize random accesses and perform multi-branch octree construction efficiently. Furthermore, in the search stage, we present algorithm-architecture co-optimization, including parallel keyframe-based scheduling and multi-branch flexible search engines, to provide conflict-free access and maximum reuse opportunities for reference points, which achieves more than 27.0× speedup compared with baseline architectures. We prototype ParallelNN on Virtex HBM FPGA and perform extensive benchmarking on the KITTI dataset. The results demonstrate that ParallelNN achieves up to 107.7× and 12.1× speedup over CPU and GPU implementations, while being more energy efficient, e.g., outperforming CPU and GPU implementations by 73.6× and 31.1×, respectively. Besides, with the proposed algorithm-architecture co-optimization, ParallelNN achieves 11.4× speedup over state-of-the-art architecture. Moreover, ParallelNN is configurable and can be easily generalized to similar octree-based applications.

A parallel implementation of nearest neighbor analysis based on GPGPU

Implementation of K-nearest Neighbor Algorithm Based on GPU

Accelerating Geospatial Analysis on GPUs Using CUDA

A Nearest Neighbor Searches(NNS) Algorithm for Fast Registration of 3D Point Clouds Based on GPGPU

GPU-accelerated Proximity Graph Approximate Nearest Neighbor Search and Construction

Parallel data mining techniques on Graphics Processing Unit with Compute Unified Device Architecture (CUDA)

A Parallel Scheme for Large-scale Polygon Rasterization on CUDA-enabled GPUs.

A Parallel Strategy to Accelerate Neighborhood Operation for Raster Data Coordinating CPU and GPU

Accelerating Genome-Wide Association Studies Using CUDA Compatible Graphics Processing Units

Study of A Gpu-Based Parallel Computing Method for the Monte Carlo Program

Parallelization of Spectral Clustering Algorithm on Multi-Core Processors and GPGPU

Accelerating Spatial Cross-Matching on CPU-GPU Hybrid Platform With CUDA and OpenACC

ParallelNN: A Parallel Octree-based Nearest Neighbor Search Accelerator for 3D Point Clouds

Local acceleration in Distributed Geographic Information Processing with CUDA

Parallel L-BFGS-B Algorithm on GPU.

Design and implementation of a parallel geographically weighted -nearest neighbor classifier.

Parallel Data Mining on Graphics Processors

Semi-Convex Hull Tree: Fast Nearest Neighbor Queries for Large Scale Data on GPUs

Parallel Viewshed Analysis on GPU Using CUDA

CAGRA: Highly Parallel Graph Construction and Approximate Nearest Neighbor Search for GPUs

Parallel Monte Carlo Integration Algorithm Based on GPU