Abstract:Increasing automation calls for evaluating the effectiveness and intelligence of automated vehicles. This paper proposes a framework for quantitatively evaluating the intelligence of automated vehicles. Firstly, we establish the evaluation environment for automated vehicles including test field, test task, and evaluation index. The test tasks include the single vehicle decision-making (turning, lane-changing, overtaking, etc.) and the maneuver execution of multi-vehicle interaction (obstacle avoidance, trajectory optimization, etc.). The intelligence evaluation index is the action amount of driving process considering the safety, efficiency, rationality and comfort. Then, we calculate the actual action amount of the automated vehicle in different scenarios in the test field. Finally, the least action calculated theoretically corresponds to the highest intelligence degree of the automated vehicle, and is employed as a standard to quantify the performance of other tested automated vehicles. The effectiveness of this framework is verified with two naturalistic driving datasets that contain the normal driving scenarios and high-risk scenarios. Specifically, the naturalistic lane-changing data filters 40,416 frames and 179 similar lane-changing trajectories. Compared with the lane-changing behavior of a large number of drivers, experimental results verify that the proposed algorithm can achieve the intelligence degree of drivers in the lane change scenario. Meanwhile, in 253 reconstructed high-risk scenarios, the intelligent risk avoidance ability of the proposed intelligence degree evaluation algorithm can be verified by comparing with the driver behavior and TTC algorithm. These experimental results show that the proposed framework can effectively quantify intelligence and evaluate the performance of automated vehicles under various scenarios.

A Cognitively Inspired System Architecture for the Mengshi Cognitive Vehicle

iCPS-Car: An Intelligent Cyber-physical System for Smart Automobiles

Interactive cognition in self-driving

A Hardware Structure Design for Intelligent Micro-vehicles Based on Visual Sensors

Modular Smart Vehicle Design and Technology for Shared Mobility

Toward Cognitive Vehicles

An Integrated Architecture for Intelligence Evaluation of Automated Vehicles.

Brain Inspired Cognitive Model with Attention for Self-Driving Cars

Cognitive Cars: A New Frontier for ADAS Research

3D Collaborative Judgment MobileNet Based Intelligent Driving System

Design and Realization of Unmanned Multi‐mode Collaborative Intelligent Driving System

Design of a Deep Learning-Based Autonomous Vehicle Environmental Perception and Decision-Making System

Software Architecture for Intelligent Ground Vehicles

On-Board Vision-Language Models for Personalized Autonomous Vehicle Motion Control: System Design and Real-World Validation

Architecture design of a vehicle–road-cloud collaborative automated driving system

Hardware and Software Architecture of Intelligent Vehicles and Road Verification in Typical Traffic Scenarios

Application and Implementation of Artificial Intelligence Technology for Intelligent Vehicle

A Sensor Array-based Control System Design for the Interior Environment of Driverless Cars

A new synchronous control method for dual motor electric vehicle based on cognitive-inspired and intelligent interaction

Analyze on multi-vehicle coordination-enhanced intelligent driving framework based on human–machine hybrid intelligence

Environmentally Friendly Intelligent Vehicle:Concept,Architecture and Implementation