Abstract:The need for a vehicle to perceive information about the external environmental as an independent intelligent individual has grown with the progress of intelligent driving from primary driver assistance to high-level autonomous driving. The ability of a common independent sensing unit to sense the external environment is limited by the sensor’s own characteristics and algorithm level. Hence, a common independent sensing unit fails to obtain comprehensive sensing information independently under conditions such as rain, fog, and night. Accordingly, an extended network-based fusion target detection algorithm for millimeter-wave radar and vision fusion is proposed in this work by combining the complementary perceptual performance of in-vehicle sensing elements, cost effectiveness, and maturity of independent detection technologies. Feature-level fusion is first used in this work according to the analysis of technical routes of the millimeter-wave radar and vision fusion. Training and test evaluation of the algorithm are carried out on the nuScenes dataset and test data from a homemade data acquisition platform. An extended investigation on the RetinaNet one-stage target detection algorithm based on the VGG-16+FPN backbone detection network is then conducted in this work to introduce millimeter-wave radar images as auxiliary information for visual image target detection. We use two-channel radar and three-channel visual images as inputs of the fusion network. We also propose an extended VGG-16 network applicable to millimeter-wave radar and visual fusion and an extended feature pyramid network. Test results showed that the mAP of the proposed network improves by 2.9% and the small target accuracy is enhanced by 18.73% compared with those of the reference network for pure visual image target detection. This finding verified the detection capability and algorithmic feasibility of the proposed extended fusion target detection network for visually insensitive targets.

SAR Image Target Recognition Based on NMF Feature Extraction and Bayesian Decision Fusion

TARGET RECOGNITION FOR MULTI-ASPECT SAR IMAGES WITH FUSION STRATEGIES

SAR Target Recognition with the Fusion of LDA and ICA

Decision Fusion Strategies For Sar Image Target Recognition

Millimeter-Wave Radar and Vision Fusion Target Detection Algorithm Based on an Extended Network

SAR Target Recognition Using PCA, ICA and Gabor Wavelet Decision Fusion

A Vehicle Target Recognition Algorithm for Wide-Angle SAR Based on Joint Feature Set Matching

SAR Target Recognition Based on Joint Representation of Multimode Representations

Attention feature fusion awareness network for vehicle target detection in SAR images

Synthetic Aperture Radar Target Recognition with Feature Fusion Based on a Stacked Autoencoder

SAR target recognition via sparse representation of multi-view SAR images with correlation analysis

Two-Stream Deep Fusion Network Based on VAE and CNN for Synthetic Aperture Radar Target Recognition

Target recognition of SAR images via hierarchical fusion of complementary features

Vehicle Target Detection Method for Wide-Area SAR Images Based on Coarse-Grained Judgment and Fine-Grained Detection

FEF-Net: A Deep Learning Approach to Multiview SAR Image Target Recognition

A multi-view stable feature extraction network for SAR target recognition

Automatic Target Recognition in SAR Images Based on a Combination of CNN and SVM

SAR Target Classification Based on Integration of ASC Parts Model and Deep Learning Algorithm

Recognition of targets in SAR images using joint classification of deep features fused by multi-canonical correlation analysis

SAR target recognition using nonnegative matrix factorization with L1/2 constraint

SAR Multi‐target Interactive Motion Recognition Based on Convolutional Neural Networks