Abstract:Increasing automation calls for evaluating the effectiveness and intelligence of automated vehicles. This paper proposes a framework for quantitatively evaluating the intelligence of automated vehicles. Firstly, we establish the evaluation environment for automated vehicles including test field, test task, and evaluation index. The test tasks include the single vehicle decision-making (turning, lane-changing, overtaking, etc.) and the maneuver execution of multi-vehicle interaction (obstacle avoidance, trajectory optimization, etc.). The intelligence evaluation index is the action amount of driving process considering the safety, efficiency, rationality and comfort. Then, we calculate the actual action amount of the automated vehicle in different scenarios in the test field. Finally, the least action calculated theoretically corresponds to the highest intelligence degree of the automated vehicle, and is employed as a standard to quantify the performance of other tested automated vehicles. The effectiveness of this framework is verified with two naturalistic driving datasets that contain the normal driving scenarios and high-risk scenarios. Specifically, the naturalistic lane-changing data filters 40,416 frames and 179 similar lane-changing trajectories. Compared with the lane-changing behavior of a large number of drivers, experimental results verify that the proposed algorithm can achieve the intelligence degree of drivers in the lane change scenario. Meanwhile, in 253 reconstructed high-risk scenarios, the intelligent risk avoidance ability of the proposed intelligence degree evaluation algorithm can be verified by comparing with the driver behavior and TTC algorithm. These experimental results show that the proposed framework can effectively quantify intelligence and evaluate the performance of automated vehicles under various scenarios.

Application of Gray Correlation and Improved Ahp to Evaluation on Intelligent U-Turn Behavior of Unmanned Vehicles

Evaluation of the U-Turn Behavior of Unmanned Ground Vehicles Based on the FUZZY-PCA Method

Evaluation of the Intelligent Behaviors of Unmanned Ground Vehicles Based on Fuzzy-EAHP Scheme

Evaluation Framework and Method of the Intelligent Behaviors of Unmanned Ground Vehicles Based on AHP Scheme

The Fuzzy-AHP Evaluation Method for Unmanned Ground Vehicles

Performance Evaluation for Tracking Algorithm Based on AHP

Evaluation of the Intelligent Behaviors of Unmanned Ground Vehicles Based on Information Theory

Evaluation of Self-repairing Control Policies for UAV Based on Grey Relational Analytic Hierarchy

Fuzzy synthetic evaluation of driving abilities for intelligent vehicles

The Entropy-Cost Function Evaluation Method for Unmanned Ground Vehicles

An Improved Grey Relational Theory Evaluation Method: Considering the Comprehensive Performance of Autonomous Vehicles in Virtual Test

A cost function-oriented quantitative evaluation method for unmanned ground vehicles

An Evaluation Method for Automated Vehicles Combining Subjective and Objective Factors

Research on the Quantitative Evaluation System for Unmanned Ground Vehicles

A Method for Effectiveness Evaluation of Underwater Vehicles Based on Grey System Theory

Task-Specific Performance Evaluation of Ugvs: Case Studies at the Ivfc

An Integrated Architecture for Intelligence Evaluation of Automated Vehicles.

Comprehensive Evaluation Method for Performance of Unmanned Robot Applied to Automotive Test Using Fuzzy Logic and Evidence Theory and FNN.

Evaluation of Strategy of Anti-torpedo Underwater Acoustic Countermeasure Based on Fuzzy Analytic Hierarchy Process

Research of Effectiveness Evaluation for Underwater Vehicle based on Grey Associative Analysis

The Combined Evaluation Method Based On Analytic Hierarchy Process And Support Vector Machine