Abstract:The need for a vehicle to perceive information about the external environmental as an independent intelligent individual has grown with the progress of intelligent driving from primary driver assistance to high-level autonomous driving. The ability of a common independent sensing unit to sense the external environment is limited by the sensor’s own characteristics and algorithm level. Hence, a common independent sensing unit fails to obtain comprehensive sensing information independently under conditions such as rain, fog, and night. Accordingly, an extended network-based fusion target detection algorithm for millimeter-wave radar and vision fusion is proposed in this work by combining the complementary perceptual performance of in-vehicle sensing elements, cost effectiveness, and maturity of independent detection technologies. Feature-level fusion is first used in this work according to the analysis of technical routes of the millimeter-wave radar and vision fusion. Training and test evaluation of the algorithm are carried out on the nuScenes dataset and test data from a homemade data acquisition platform. An extended investigation on the RetinaNet one-stage target detection algorithm based on the VGG-16+FPN backbone detection network is then conducted in this work to introduce millimeter-wave radar images as auxiliary information for visual image target detection. We use two-channel radar and three-channel visual images as inputs of the fusion network. We also propose an extended VGG-16 network applicable to millimeter-wave radar and visual fusion and an extended feature pyramid network. Test results showed that the mAP of the proposed network improves by 2.9% and the small target accuracy is enhanced by 18.73% compared with those of the reference network for pure visual image target detection. This finding verified the detection capability and algorithmic feasibility of the proposed extended fusion target detection network for visually insensitive targets.

Vehicle Classification Applying Many‐to‐one Input Network Architecture in 77‐ghz FMCW Radar

Point Cloud Features-Based Kernel SVM for Human-Vehicle Classification in Millimeter Wave Radar.

Millimeter-Wave Radar and Vision Fusion Target Detection Algorithm Based on an Extended Network

Improved Waveform‐feature‐based Vehicle Classification Using a Single‐point Magnetic Sensor

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

A Ground Vehicle Classification Approach Using Unmodulated Continuous-Wave Radar

Vehicle Classification Via Multi-dimension Feature Extraction with Millimeter Wave Radar

RAMP-CNN: A Novel Neural Network for Enhanced Automotive Radar Object Recognition

Vehicle Occupant Detection Based on MM-Wave Radar

Vehicle Classification Based on Seismic Signatures Using Convolutional Neural Network

Radar Transformer: An Object Classification Network Based on 4D MMW Imaging Radar

Research of Target Detection and Classification Techniques Using Millimeter-Wave Radar and Vision Sensors

Automated Vehicle Recognition with Deep Convolutional Neural Networks

Doppler-Spectrum Feature-Based Human-Vehicle Classification Scheme Using Machine Learning for an FMCW Radar Sensor

A Low-Cost Vehicle Detection And Classification System Based On Unmodulated Continuous-Wave Radar

Multi-Task Vehicle Detection with Region-of-Interest Voting.

Fine-Grained Vehicle Model Recognition Using A Coarse-to-Fine Convolutional Neural Network Architecture

Multi-attack and multi-classification intrusion detection for vehicle-mounted networks based on mosaic-coded convolutional neural network

Few-shot recognition of multi-function radar modes via Refined Prototypical Random Walk Network

OIF-CBDN: Orientation Information Fusion CBD Network for UWB-IR Vehicle Classification