Abstract:Object boundary estimation, usually achieved by bounding box estimation, is crucial in various applications, such as intelligent driving, which facilitates further interactions like obstacle avoidance and navigation. Existing solutions mainly rely on computer vision, which often performs poorly in low-visibility conditions, e.g., harsh weather, and has limited resolution for depth estimation. Recent studies show the potential of mmWave radar for object detection. However, due to the inherent drawbacks, conventional mmWave techniques suffer from the severe interference of noise points in the points cloud, leading to the position vagueness, as well as sparsity and limited spatial resolution, which leads to the boundary vagueness. In this paper, we propose a novel bounding box estimation system based on mmWave radar that sufficiently leverages the spatial features of the antenna array and the temporal features of moving scanning to detect objects and estimate their 3D bounding boxes. To mitigate the interference from noise points, we introduce a new integration metric, Reflection Saliency, which evaluates the effectiveness of each point based on signal-to-noise ratio (SNR), speed, and spatial domains, successfully reducing the majority of noise points. Moreover, we propose the Prior-Time Heuristic Point Cloud Augmentation method to enrich the point representation of objects based on the previous data. To obtain boundary information, we propose a beamforming-based model to extract the Angle-Reflection Profile (ARP), which depicts the spatial distribution of the object's reflection. Furthermore, a generative neural network is used to refine the boundary and estimate the 3D bounding box by incorporating the ARP features, SNR of cloud points, and depth information. We have implemented an actual system prototype using a robot car in real scenarios and extensive experiments show that the average position error of the proposed system in 3D bounding box estimation is 0.11m.

Super-resolution Localization Problem Based on the Mobile Scenario

Indoor Wireless Positioning Utilizing WSN and Machine Vision

Radar2: Passive Spy Radar Detection and Localization Using COTS Mmwave Radar

RoLM: Radar on LiDAR Map Localization.

Radar Style Transfer for Metric Robot Localisation on Lidar Maps

RaLL: End-to-end Radar Localization on Lidar Map Using Differentiable Measurement Model

Research on a Super-Resolution and Low-Complexity Positioning Algorithm Using FMCW Radar Based on OMP and FFT in 2D Driving Scene

Scalable Radar-based Roadside Perception: Self-localization and Occupancy Heat Map for Traffic Analysis

Efficient algorithms for moving objects localization and tracking based on continuous Wave Doppler radar

FMCW Radar on LiDAR map localization in structural urban environments

Online Tensor Method for Moving Objective Detection with FMCW Radar

Research and Simulation of Millimeter Wave Radar Localization Method for Indoor Mobile Robots

A Portable Fmcw Interferometry Radar with Programmable Low-If Architecture for Localization, Isar Imaging, and Vital Sign Tracking

LoCal: An Automatic Location Attribute Calibration Approach for Large-Scale Deployment of mmWave-based Sensing Systems

Applying Extended Object Tracking for Self-Localization of Roadside Radar Sensors

DC-Loc: Accurate Automotive Radar Based Metric Localization with Explicit Doppler Compensation

Urban Traffic Imaging Using Millimeter-Wave Radar

Radar Accurate Localization of UAV Swarms Based on Range Super-Resolution Method

CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radar

Diffusion-Based Point Cloud Super-Resolution for mmWave Radar Data

3D Bounding Box Estimation Based on COTS Mmwave Radar Via Moving Scanning