Abstract:Robust sensor fusion is a key technology for enabling the safe operation of automated vehicles. Sensor fusion typically utilizes inputs of cameras, radars, lidar, inertial measurement unit, and global navigation satellite systems, process them, and then output object detection or positioning data. This paper will focus on sensor fusion between the camera, radar, and vehicle wheel speed sensors which is a critical need for near-term realization of sensor fusion benefits. The camera is an off-the-shelf computer vision product from MobilEye and the radar is a Delphi/Aptive electronically scanning radar (ESR) both of which are connected to a drive-by-wire capable vehicle platform. We utilize the MobilEye and wheel speed sensors to create a dynamic region of interest (DROI) of the drivable region that changes as the vehicle moves through the environment. The use of the DROI can reduce the need for up to approximately 100% of the detections from radar, for processing of the driveable region. This provides not only accurate and robust detections but also has benefits in lowering computational power and time complexity. We then continue to reduce the number of detections in the driveable region using machine learning techniques such as density-based spatial clustering and applications with noise (DBSCAN). This is followed by KMeans clustering to further reduce detections and lastly fused with the extended Kalman filter. Our experimental results obtained using an instrumented vehicle show a large reduction in the need for radar detections processing after both, fusion with our DROI and further clustering using machine learning techniques for the driveable region. Our proposed complete technique decreases the amount of fused misdetection, decreases computational power, and increases the reliability of the fused perception model which can greatly benefit current Advanced Driver Assistance System products available on the market today.

Multi-modal sensor fusion for highly accurate vehicle motion state estimation

Robust and Efficient Vehicles Motion Estimation with Low-Cost Multi-Camera and Odometer-Gyroscope

A Sensor Fusion Approach for Localization with Cumulative Error Elimination

Radar and Camera Fusion for Multi-Task Sensing in Autonomous Driving

Cascaded Motion Estimation for Intelligent Vehicles in GNSS-Denied Scenes

Vehicle Velocity Estimation Fusion With Kinematic Integral And Empirical Correction On Multi-Timescales

Intelligent vehicle sideslip angle estimation considering measurement signals delay.

Graph-Based Multi-Modal Sensor Fusion for Autonomous Driving

MSFusion: Multilayer Sensor Fusion-Based Robust Motion Estimation

Method for Estimating Vehicle Speed Based on Multi-Sensor Fusion

Reliable Vehicle Sideslip Angle Fusion Estimation Using Low-Cost Sensors

A Reliable Fusion Methodology for Simultaneous Estimation of Vehicle Sideslip and Yaw Angles

Multi-Sensor Data Fusion for Real-Time Multi-Object Tracking

Low-Cost Hybrid Multisensor Fusion Method and Implementation for Production Intelligent Vehicles.

Multi-Camera Sensor Fusion for Visual Odometry using Deep Uncertainty Estimation

Multi-sensor Fusion Method Using Dynamic Bayesian Network for Precise Vehicle Localization and Road Matching

Study of Assisted Driving System Based on Multi-Sensor Information Fusion

Vehicle State Estimation Based on Multidimensional Information Fusion.

Higher Accuracy and Lower Computational Perception Environment Based Upon a Real-time Dynamic Region of Interest

Multi-Sensor Fusion for Navigation and Mapping in Autonomous Vehicles: Accurate Localization in Urban Environments

A reliable multisensor fusion strategy for land vehicle positioning using low-cost sensors