Abstract:Increasing automation calls for evaluating the effectiveness and intelligence of automated vehicles. This paper proposes a framework for quantitatively evaluating the intelligence of automated vehicles. Firstly, we establish the evaluation environment for automated vehicles including test field, test task, and evaluation index. The test tasks include the single vehicle decision-making (turning, lane-changing, overtaking, etc.) and the maneuver execution of multi-vehicle interaction (obstacle avoidance, trajectory optimization, etc.). The intelligence evaluation index is the action amount of driving process considering the safety, efficiency, rationality and comfort. Then, we calculate the actual action amount of the automated vehicle in different scenarios in the test field. Finally, the least action calculated theoretically corresponds to the highest intelligence degree of the automated vehicle, and is employed as a standard to quantify the performance of other tested automated vehicles. The effectiveness of this framework is verified with two naturalistic driving datasets that contain the normal driving scenarios and high-risk scenarios. Specifically, the naturalistic lane-changing data filters 40,416 frames and 179 similar lane-changing trajectories. Compared with the lane-changing behavior of a large number of drivers, experimental results verify that the proposed algorithm can achieve the intelligence degree of drivers in the lane change scenario. Meanwhile, in 253 reconstructed high-risk scenarios, the intelligent risk avoidance ability of the proposed intelligence degree evaluation algorithm can be verified by comparing with the driver behavior and TTC algorithm. These experimental results show that the proposed framework can effectively quantify intelligence and evaluate the performance of automated vehicles under various scenarios.

Virtual subjective and objective evaluation method of traffic jam assist

Based on Simulation Method for Solving Traffic Jam Problems.

&Lt;title>automatic Traffic Real-Time Analysis System Based on Video</title>

An Evaluation Method for Automated Vehicles Combining Subjective and Objective Factors

Real-time Joint Traffic State and Model Parameter Estimation on Freeways with Fixed Sensors and Connected Vehicles: State-of-the-art Overview, Methods, and Case Studies

An Improved Grey Relational Theory Evaluation Method: Considering the Comprehensive Performance of Autonomous Vehicles in Virtual Test

Automatic Virtual Test Technology for Intelligent Driving Systems Considering Both Coverage and Efficiency

Automated Scenario Generation and Iterative Regression Testing Method for Autonomous Driving Systems

Performance Evaluation Method for Automated Driving System in Logical Scenario

Evaluation of Traffic Congestion Degree: an Integrated Approach.

A VIRTUAL TEST APPROACH FOR VEHICLE RIDE COMFORT EVALUATION. IN: HUMAN FACTORS IN DRIVING AND TELEMATICS, AND SEATING COMFORT

A Novel Integrated Decision-Making Evaluation Method Towards ICV Testing Involving Multiple Driving Experience Factors

Intelligent Traffic Guidance System Based on Dynamic Toll Collection Policy

Subjective evaluation on human-machine-environment system of automotive driving simulation experiment platform

A Novel Fuzzy Comprehensive Evaluation Model for Application Effect of Connected Vehicle System in a Tunnel Scenario

Evaluation method with digital expert on the criticality of car-following scenarios for autonomous vehicles testing

An Integrated Architecture for Intelligence Evaluation of Automated Vehicles.

Integrated Framework for Test and Evaluation of Autonomous Vehicles

A Comprehensive Evaluation of Vehicle Intelligent Barrier Avoidance Function under Special Roads Based on G1-CRITIC

Research on the Real-Time Dynamic Evaluation of Public Transport Passenger Service Satisfaction Based on the Internet

Scalable Evaluation Methods for Autonomous Vehicles