Abstract:Increasing automation calls for evaluating the effectiveness and intelligence of automated vehicles. This paper proposes a framework for quantitatively evaluating the intelligence of automated vehicles. Firstly, we establish the evaluation environment for automated vehicles including test field, test task, and evaluation index. The test tasks include the single vehicle decision-making (turning, lane-changing, overtaking, etc.) and the maneuver execution of multi-vehicle interaction (obstacle avoidance, trajectory optimization, etc.). The intelligence evaluation index is the action amount of driving process considering the safety, efficiency, rationality and comfort. Then, we calculate the actual action amount of the automated vehicle in different scenarios in the test field. Finally, the least action calculated theoretically corresponds to the highest intelligence degree of the automated vehicle, and is employed as a standard to quantify the performance of other tested automated vehicles. The effectiveness of this framework is verified with two naturalistic driving datasets that contain the normal driving scenarios and high-risk scenarios. Specifically, the naturalistic lane-changing data filters 40,416 frames and 179 similar lane-changing trajectories. Compared with the lane-changing behavior of a large number of drivers, experimental results verify that the proposed algorithm can achieve the intelligence degree of drivers in the lane change scenario. Meanwhile, in 253 reconstructed high-risk scenarios, the intelligent risk avoidance ability of the proposed intelligence degree evaluation algorithm can be verified by comparing with the driver behavior and TTC algorithm. These experimental results show that the proposed framework can effectively quantify intelligence and evaluate the performance of automated vehicles under various scenarios.

Analyze on multi-vehicle coordination-enhanced intelligent driving framework based on human–machine hybrid intelligence

Hybrid Operations of Human Driving Vehicles and Automated Vehicles with Data-Driven Agent-Based Simulation

Research on Overall Design Framework of Networked Multi-vheicle Cooperative Control and Decision-making System

An intelligent human-machine interaction-based longitudinal control strategy for autonomous vehicles

A Survey on Hybrid Human-Artificial Intelligence for Autonomous Driving

Human-Computer Interaction of Networked Vehicles Based on Big Data and Hybrid Intelligent Algorithm

A Human-Machine Shared Control Framework Considering Time-Varying Driver Characteristics

Survey on Human-Vehicle Interactions and AI Collaboration for Optimal Decision-Making in Automated Driving

Cooperative Intelligence for Autonomous Driving

Longitudinal autonomous driving based on game theory for intelligent hybrid electric vehicles with connectivity

Design and Realization of Unmanned Multi‐mode Collaborative Intelligent Driving System

A hierarchical hybrid system of integrated longitudinal and lateral control for intelligent vehicles

A review of sensory interactions between autonomous vehicles and drivers

An Integrated Architecture for Intelligence Evaluation of Automated Vehicles.

Evolutionary Decision-Making and Planning for Autonomous Driving: A Hybrid Augmented Intelligence Framework

Path Planning and Cooperative Control for Automated Vehicle Platoon Using Hybrid Automata

Towards Safe and Robust Autonomous Vehicle Platooning: A Self-Organizing Cooperative Control Framework

Societal Intelligence for Safer and Smarter Transportation

Bringing Diversity to Autonomous Vehicles: An Interpretable Multi-vehicle Decision-making and Planning Framework

A comprehensive approach to evaluate human-machine conflicts in shared steering systems

Toward human-vehicle collaboration: Review and perspectives on human-centered collaborative automated driving