Abstract:Radar sensors are vital for autonomous driving due to their consistent and dependable performance, even in challenging weather conditions. Semantic segmentation of moving objects in sparse radar point clouds is an emerging task that contributes to improving the safety of autonomous driving. However, the methods still need to be explored since radar points in driving scenes are distributed sparsely and irregularly. Typical methods address the sparsity by aggregating multi-scan data to generate dense point clouds, where the temporal correlation is ignored. Inputting consecutive frames of point clouds can preserve temporal information, but the irregular distribution makes it difficult to achieve interframe communications. In this article, we propose a scheme to process points of multi-scan data into a single frame with the availability of temporal features. Our novel network, called Spatial and Temporal Awareness Network (STA-Net), enables points at different times to interact and establish their spatiotemporal connections to comprehend the surroundings of these points. Furthermore, we design a shallow feature extraction method based on the radar measurements of points, which enhances the representation of local features. To further improve the capability of the network to distinguish between various moving objects, we also introduce a prompt layer inspired by prompt-based learning. This layer instructs the network to generate a discriminative representation for each type of moving object. Our experiments demonstrate that our network achieves state-of-the-art performance compared to other methods designed on the RadarScenes dataset. In particular, it shows a remarkable ability to segment small objects such as pedestrians.

Enhanced Radar for Object Recognition Based on GANs

Radar Style Transfer for Metric Robot Localisation on Lidar Maps

Enhancing Object Recognition with Multi-View Radar Data Using Convolutional Neural Network

PCGNet: Point Cloud Generation Network for 3D Perception using Monocular Images and Radar

A Generative Adversarial Network-based Method for LiDAR-Assisted Radar Image Enhancement

RAMP-CNN: A Novel Neural Network for Enhanced Automotive Radar Object Recognition

A Novel Radar Point Cloud Generation Method for Robot Environment Perception

RODNet: Radar Object Detection Using Cross-Modal Supervision

Road target recognition based on radar range-Doppler spectrum with GS – ResNet

A Deep Convolutional Generative Adversarial Networks (DCGANs)-Based Semi-Supervised Method for Object Recognition in Synthetic Aperture Radar (SAR) Images

A Data-Driven Method for Indoor Radar Ghost Recognition with Environmental Mapping

Mask-RadarNet: Enhancing Transformer With Spatial-Temporal Semantic Context for Radar Object Detection in Autonomous Driving

Spatial and Temporal Awareness Network for Semantic Segmentation on Automotive Radar Point Cloud

Integrated GANs: Semi-Supervised SAR Target Recognition

Object Detection of Millimeter Wave Radar Based on Computer Vision

Human Detection and Action Classification Based on Millimeter Wave Radar Point Cloud Imaging Technology

300 GHz Radar Object Recognition based on Deep Neural Networks and Transfer Learning

A Radar HRRP Target Recognition Method Based on Conditional Wasserstein VAEGAN and 1-D CNN.

Enhanced 3D Object Detection Using 4D Radar and Vision Fusion with Segmentation Assistance

Research of Target Detection and Classification Techniques Using Millimeter-Wave Radar and Vision Sensors