Diffusion-Based Point Cloud Super-Resolution for mmWave Radar Data

Kai Luan,Chenghao Shi,Neng Wang,Yuwei Cheng,Huimin Lu,Xieyuanli Chen

2024-04-09

Abstract:The millimeter-wave radar sensor maintains stable performance under adverse environmental conditions, making it a promising solution for all-weather perception tasks, such as outdoor mobile robotics. However, the radar point clouds are relatively sparse and contain massive ghost points, which greatly limits the development of mmWave radar technology. In this paper, we propose a novel point cloud super-resolution approach for 3D mmWave radar data, named Radar-diffusion. Our approach employs the diffusion model defined by mean-reverting stochastic differential equations(SDE). Using our proposed new objective function with supervision from corresponding LiDAR point clouds, our approach efficiently handles radar ghost points and enhances the sparse mmWave radar point clouds to dense LiDAR-like point clouds. We evaluate our approach on two different datasets, and the experimental results show that our method outperforms the state-of-the-art baseline methods in 3D radar super-resolution tasks. Furthermore, we demonstrate that our enhanced radar point cloud is capable of downstream radar point-based registration tasks.

Computer Vision and Pattern Recognition,Robotics

What problem does this paper attempt to address?

The paper attempts to address the problem of achieving super-resolution in millimeter-wave radar point cloud data to improve the density and quality of the point cloud. Millimeter-wave radar has become a promising solution for all-weather perception tasks such as outdoor mobile robots due to its stable performance under harsh environmental conditions. However, millimeter-wave radar point cloud data is relatively sparse and contains a large number of ghost points, which greatly limits the development of millimeter-wave radar technology. Therefore, this paper proposes a novel point cloud super-resolution method based on a diffusion model—Radar-diffusion, which aims to handle ghost points in radar and enhance the sparse millimeter-wave radar point cloud to a dense point cloud similar to LiDAR, thereby overcoming the limitations of existing technologies and improving the application capability of millimeter-wave radar in complex environments.