Abstract:Robust sensor fusion is a key technology for enabling the safe operation of automated vehicles. Sensor fusion typically utilizes inputs of cameras, radars, lidar, inertial measurement unit, and global navigation satellite systems, process them, and then output object detection or positioning data. This paper will focus on sensor fusion between the camera, radar, and vehicle wheel speed sensors which is a critical need for near-term realization of sensor fusion benefits. The camera is an off-the-shelf computer vision product from MobilEye and the radar is a Delphi/Aptive electronically scanning radar (ESR) both of which are connected to a drive-by-wire capable vehicle platform. We utilize the MobilEye and wheel speed sensors to create a dynamic region of interest (DROI) of the drivable region that changes as the vehicle moves through the environment. The use of the DROI can reduce the need for up to approximately 100% of the detections from radar, for processing of the driveable region. This provides not only accurate and robust detections but also has benefits in lowering computational power and time complexity. We then continue to reduce the number of detections in the driveable region using machine learning techniques such as density-based spatial clustering and applications with noise (DBSCAN). This is followed by KMeans clustering to further reduce detections and lastly fused with the extended Kalman filter. Our experimental results obtained using an instrumented vehicle show a large reduction in the need for radar detections processing after both, fusion with our DROI and further clustering using machine learning techniques for the driveable region. Our proposed complete technique decreases the amount of fused misdetection, decreases computational power, and increases the reliability of the fused perception model which can greatly benefit current Advanced Driver Assistance System products available on the market today.

Fusion information refresh rate improvement based on adaptive visual tracking in vehicle augmented reality sightseeing interactive system

3-D Surround View for Advanced Driver Assistance Systems.

A Visual-Inertial Fusion Based Tracking System For Mobile Augmented Reality

An Off-Screen Object Visualization Approach for Mobile Augment Reality

Cloud-based Fusion Rendering for AR Applications

Real time stereo rendering for augmented reality on 3DTV system

Multi-sensor Fusion for Interactive Visual Computing in Mixed Environment.

35.1: A novel in‐situ interactive 3D floating autostereoscopic display system with aerial imaging plate

A Flexible-Frame-Rate Vision-Aided Inertial Object Tracking System for Mobile Devices

Vehicle Augmented Reality Head-up Display information visualization enhancement algorithm and system

Distortion Correction Algorithm of AR-HUD Virtual Image based on Neural Network Model of Spatial Continuous Mapping

Map Recovery and Fusion for Collaborative Augment Reality of Multiple Mobile Devices

Higher Accuracy and Lower Computational Perception Environment Based Upon a Real-time Dynamic Region of Interest

Stereo Content Fusion Display Technology Research Based on Eye Tracking

VIPS: Real-Time Perception Fusion for Infrastructure-Assisted Autonomous Driving

Blind-Spot Visualization Via AR Glasses Using Millimeter-Wave V2X for Safe Driving

A multi-modal spatial–temporal model for accurate motion forecasting with visual fusion

Cooperative Visual Augmentation Algorithm of Intelligent Vehicle Based on Inter-Vehicle Image Fusion

ARToolKit Target Tracking and Animation Fusion Technology Based on Edge Computing and Augmented Reality

Automotive Augmented Reality Head-Up Displays

How does AR-HUD system affect driving behaviour Evidence from an eye-tracking experiment study