Abstract:Increasing automation calls for evaluating the effectiveness and intelligence of automated vehicles. This paper proposes a framework for quantitatively evaluating the intelligence of automated vehicles. Firstly, we establish the evaluation environment for automated vehicles including test field, test task, and evaluation index. The test tasks include the single vehicle decision-making (turning, lane-changing, overtaking, etc.) and the maneuver execution of multi-vehicle interaction (obstacle avoidance, trajectory optimization, etc.). The intelligence evaluation index is the action amount of driving process considering the safety, efficiency, rationality and comfort. Then, we calculate the actual action amount of the automated vehicle in different scenarios in the test field. Finally, the least action calculated theoretically corresponds to the highest intelligence degree of the automated vehicle, and is employed as a standard to quantify the performance of other tested automated vehicles. The effectiveness of this framework is verified with two naturalistic driving datasets that contain the normal driving scenarios and high-risk scenarios. Specifically, the naturalistic lane-changing data filters 40,416 frames and 179 similar lane-changing trajectories. Compared with the lane-changing behavior of a large number of drivers, experimental results verify that the proposed algorithm can achieve the intelligence degree of drivers in the lane change scenario. Meanwhile, in 253 reconstructed high-risk scenarios, the intelligent risk avoidance ability of the proposed intelligence degree evaluation algorithm can be verified by comparing with the driver behavior and TTC algorithm. These experimental results show that the proposed framework can effectively quantify intelligence and evaluate the performance of automated vehicles under various scenarios.

A User Interface Design for Collaborations Between Humans and Intelligent Vehicles.

Survey on Human-Vehicle Interactions and AI Collaboration for Optimal Decision-Making in Automated Driving

Design and Implementation of Intelligent Event-Driven Human-Computer Interface on Vehicles

Ai-Enhanced Incentive Design For Crowdsourcing In Internet Of Vehicles

Toward Collaborative Intelligence in IoV Systems: Recent Advances and Open Issues

Interactive cognition in self-driving

A Framework for Function Allocations in Intelligent Driver Interface Design for Comfort and Safety

Human-Computer Interaction of Networked Vehicles Based on Big Data and Hybrid Intelligent Algorithm

Social Intelligence for Autonomous Vehicles Interacting With Vulnerable Road Users

A Human-Vehicle Collaborative Simulated Driving System Based on Hybrid Brain-Computer Interfaces and Computer Vision.

An Integrated Architecture for Intelligence Evaluation of Automated Vehicles.

Parallel Orientation Assistant, a Vehicle System Based on Voice Interaction and Multi-screen Interaction.

Human-AI Teamwork Interface Design Using Patterns of Interactions

Designing Future In-Vehicle Assistants: Insights from User Imaginations and Experiences.

From Car-Driver-Handovers to Cooperative Interfaces: Visions for Driver–Vehicle Interaction in Automated Driving

Human-Oriented Online Driving Authority Optimization for Driver-Automation Shared Steering Control

Designing for Implicit and Positive Interactions - Artificial Intelligence and the Internet of Things in Support of Car Drivers

Social Car: the Research of Interaction Design on the Driver's Communication System.

A Survey of Collaborative Perception in Intelligent Vehicles at Intersections

Information Digitization and Artificial Intelligence Applied in Smart Car HCI Development

"Tell me about that church": Exploring the Design and User Experience of In-Vehicle Multi-modal Intuitive Interface in the Context of Driving Scenario