Abstract:Robust sensor fusion is a key technology for enabling the safe operation of automated vehicles. Sensor fusion typically utilizes inputs of cameras, radars, lidar, inertial measurement unit, and global navigation satellite systems, process them, and then output object detection or positioning data. This paper will focus on sensor fusion between the camera, radar, and vehicle wheel speed sensors which is a critical need for near-term realization of sensor fusion benefits. The camera is an off-the-shelf computer vision product from MobilEye and the radar is a Delphi/Aptive electronically scanning radar (ESR) both of which are connected to a drive-by-wire capable vehicle platform. We utilize the MobilEye and wheel speed sensors to create a dynamic region of interest (DROI) of the drivable region that changes as the vehicle moves through the environment. The use of the DROI can reduce the need for up to approximately 100% of the detections from radar, for processing of the driveable region. This provides not only accurate and robust detections but also has benefits in lowering computational power and time complexity. We then continue to reduce the number of detections in the driveable region using machine learning techniques such as density-based spatial clustering and applications with noise (DBSCAN). This is followed by KMeans clustering to further reduce detections and lastly fused with the extended Kalman filter. Our experimental results obtained using an instrumented vehicle show a large reduction in the need for radar detections processing after both, fusion with our DROI and further clustering using machine learning techniques for the driveable region. Our proposed complete technique decreases the amount of fused misdetection, decreases computational power, and increases the reliability of the fused perception model which can greatly benefit current Advanced Driver Assistance System products available on the market today.

Multi-modal Data and Model Reduction for Enabling Edge Fusion in Connected Vehicle Environments

Vehicular Edge Computing for Multi-Vehicle Perception

Multi-Variate Data Fusion Technique for Reducing Sensor Errors in Intelligent Transportation Systems

EcoFusion: Energy-Aware Adaptive Sensor Fusion for Efficient Autonomous Vehicle Perception

Real-Time Hybrid Multi-Sensor Fusion Framework for Perception in Autonomous Vehicles

Large-Scale Bandwidth and Power Optimization for Multi-Modal Edge Intelligence Autonomous Driving

Edge-Aided Sensor Data Sharing in Vehicular Communication Networks

Redefining Real-Time Road Quality Analysis With Vision Transformers on Edge Devices

Higher Accuracy and Lower Computational Perception Environment Based Upon a Real-time Dynamic Region of Interest

Optimizing Information Freshness for MEC-Enabled Cooperative Autonomous Driving

Joint computation offloading and resource allocation for end-edge collaboration in internet of vehicles via multi-agent reinforcement learning

Joint perception data caching and computation offloading in MEC-enabled vehicular networks

Cognitive TransFuser: Semantics-guided Transformer-based Sensor Fusion for Improved Waypoint Prediction

F-Cooper: Feature based Cooperative Perception for Autonomous Vehicle Edge Computing System Using 3D Point Clouds

HEAD: A Bandwidth-Efficient Cooperative Perception Approach for Heterogeneous Connected and Autonomous Vehicles

Parallelized Fusion on Multisensor Transportation Data: A Case Study in CyberITS

Collaborative processing and data optimization of environmental perception technologies for autonomous vehicles

The Application of Edge Computing Technology in the Collaborative Optimization of Intelligent Transportation System Based on Information Physical Fusion

Autonomous Multi-Sensor Fusion Techniques for Environmental Perception in Self-Driving Vehicles

Improved Multimedia Object Processing for the Internet of Vehicles