Abstract:The need for a vehicle to perceive information about the external environmental as an independent intelligent individual has grown with the progress of intelligent driving from primary driver assistance to high-level autonomous driving. The ability of a common independent sensing unit to sense the external environment is limited by the sensor’s own characteristics and algorithm level. Hence, a common independent sensing unit fails to obtain comprehensive sensing information independently under conditions such as rain, fog, and night. Accordingly, an extended network-based fusion target detection algorithm for millimeter-wave radar and vision fusion is proposed in this work by combining the complementary perceptual performance of in-vehicle sensing elements, cost effectiveness, and maturity of independent detection technologies. Feature-level fusion is first used in this work according to the analysis of technical routes of the millimeter-wave radar and vision fusion. Training and test evaluation of the algorithm are carried out on the nuScenes dataset and test data from a homemade data acquisition platform. An extended investigation on the RetinaNet one-stage target detection algorithm based on the VGG-16+FPN backbone detection network is then conducted in this work to introduce millimeter-wave radar images as auxiliary information for visual image target detection. We use two-channel radar and three-channel visual images as inputs of the fusion network. We also propose an extended VGG-16 network applicable to millimeter-wave radar and visual fusion and an extended feature pyramid network. Test results showed that the mAP of the proposed network improves by 2.9% and the small target accuracy is enhanced by 18.73% compared with those of the reference network for pure visual image target detection. This finding verified the detection capability and algorithmic feasibility of the proposed extended fusion target detection network for visually insensitive targets.

Multi-radar collaborative networking method based on T-GCN

Millimeter-Wave Radar and Vision Fusion Target Detection Algorithm Based on an Extended Network

Multi-faceted Graph Attention Network for Radar Target Recognition in Heterogeneous Radar Network

Space Target Recognition Based on Radar Network Systems With BiGRU-Transformer and Dual Graph Fusion Network

Maritime Target Detection Based on Radar Graph Data and Graph Convolutional Network

RadarTCN: Lightweight Online Classification Network for Automotive Radar Targets Based on TCN

Radar Maritime Target Detection via Spatial–Temporal Feature Attention Graph Convolutional Network

PCGNet: Point Cloud Generation Network for 3D Perception using Monocular Images and Radar

Recent Advances in Multi-radar Collaborative Surveillance: Cognitive Tracking and Resource Scheduling Algorithms

Radar HRRP Target Recognition Based on Deep Multi-Scale 1D Convolutional Neural Network

Multi‐function radar work mode recognition based on residual shrinkage reconstruction recurrent neural network

A Novel Radar Signals Sorting Method Via Residual Graph Convolutional Network.

Semantic Feature-Enhanced Graph ATtention Network for Radar Target Recognition in Heterogeneous Radar Network

Spatial and Temporal Awareness Network for Semantic Segmentation on Automotive Radar Point Cloud

Decentralized Multi-Target Tracking for Netted Radar Systems with Non-Overlapping Field of View

Robust Radar Work Mode Recognition in Non-Ideal Situations with GRU-TCN Model

Research on Cooperative Detection Technology of Networked Radar Based on Data Fusion

Deep Muti-Modal Generic Representation Auxiliary Learning Networks for End-to-End Radar Emitter Classification

A Novel SAR Target Recognition Method Combining Electromagnetic Scattering Information and GCN

Radar-camera Fusion for 3D Object Detection with Aggregation Transformer

Spatio-Temporal-Frequency Graph Attention Convolutional Network for Aircraft Recognition Based on Heterogeneous Radar Network