Abstract:The need for a vehicle to perceive information about the external environmental as an independent intelligent individual has grown with the progress of intelligent driving from primary driver assistance to high-level autonomous driving. The ability of a common independent sensing unit to sense the external environment is limited by the sensor’s own characteristics and algorithm level. Hence, a common independent sensing unit fails to obtain comprehensive sensing information independently under conditions such as rain, fog, and night. Accordingly, an extended network-based fusion target detection algorithm for millimeter-wave radar and vision fusion is proposed in this work by combining the complementary perceptual performance of in-vehicle sensing elements, cost effectiveness, and maturity of independent detection technologies. Feature-level fusion is first used in this work according to the analysis of technical routes of the millimeter-wave radar and vision fusion. Training and test evaluation of the algorithm are carried out on the nuScenes dataset and test data from a homemade data acquisition platform. An extended investigation on the RetinaNet one-stage target detection algorithm based on the VGG-16+FPN backbone detection network is then conducted in this work to introduce millimeter-wave radar images as auxiliary information for visual image target detection. We use two-channel radar and three-channel visual images as inputs of the fusion network. We also propose an extended VGG-16 network applicable to millimeter-wave radar and visual fusion and an extended feature pyramid network. Test results showed that the mAP of the proposed network improves by 2.9% and the small target accuracy is enhanced by 18.73% compared with those of the reference network for pure visual image target detection. This finding verified the detection capability and algorithmic feasibility of the proposed extended fusion target detection network for visually insensitive targets.

Hybrid Gaussian process visual target classification in wireless multimedia sensor networks

Compacted Probabilistic Visual Target Classification with Committee Decision in Wireless Multimedia Sensor Networks

Collaborative Target Classification with Multiagent System in Wireless Multimedia Sensor Networks

Collaborative Statistical Learning with Rough Feature Reduction for Visual Target Classification

Collaborative Target Classification for Image Recognition in Wireless Sensor Networks

Millimeter-Wave Radar and Vision Fusion Target Detection Algorithm Based on an Extended Network

Distributed visual-target-surveillance system in wireless sensor networks

A spatial Gaussian process method for hyperspectral remote sensing imagery classification

Collaborative hybrid classifier learning with ant colony optimization in wireless multimedia sensor networks

Hierarchical Wireless Multimedia Sensor Networks for Collaborative Hybrid Semi-Supervised Classifier Learning

Dynamic Collaborative Support Vector Machine For Target Classification In Wireless Sensor Networks

Band selection based gaussian processes for hyperspectral remote sensing images classification

A Novel Hyperspectral Remote Sensing Images Classification Using Gaussian Processes with Conditional Random Fields

Gaussian process and its applications in hyperspectral image classification

Agent Collaborative Target Localization And Classification In Wireless Sensor Networks

Multi-agent Negotiation Mechanisms for Statistical Target Classification in Wireless Multimedia Sensor Networks.

Multisensor Estimation Fusion with Gaussian Process for Nonlinear Dynamic Systems

A multi-class classification approach for target localization in wireless sensor networks

Particle Swarm Optimization Clustering for Target Classification in Wireless Sensor Networks

Detection, tracking and recognition of multi-targets using fusion data from different sensors

Collaborative Probability Based Multimodel Target Identification in Wireless Sensor Networks