Abstract:Autonomous driving technologies often use state-of-the-art artificial intelligence algorithms to understand the relationship between the vehicle and the external environment, to predict the changes of the environment, and then to plan and control the behaviors of the vehicle accordingly. The complexity of such technologies makes it challenging to evaluate the performance of autonomous driving systems and to find ways to improve them. The current approaches to evaluating such autonomous driving systems largely use a single score to indicate the overall performance of a system, but domain experts have difficulties in understanding how individual components or algorithms in an autonomous driving system may contribute to the score. To address this problem, we collaborate with domain experts on autonomous driving algorithms, and propose a visual evaluation method for autonomous driving. Our method considers the data generated in all components during the whole process of autonomous driving, including perception results, planning routes, prediction of obstacles, various controlling parameters, and evaluation of comfort. We develop a visual analytics workflow to integrate an evaluation mathematical model with adjustable parameters, support the evaluation of the system from the level of the overall performance to the level of detailed measures of individual components, and to show both evaluation scores and their contributing factors. Our implemented visual analytics system provides an overview evaluation score at the beginning and shows the animation of the dynamic change of the scores at each period. Experts can interactively explore the specific component at different time periods and identify related factors. With our method, domain experts not only learn about the performance of an autonomous driving system, but also identify and access the problematic parts of each component. Our visual evaluation system can be applied to the autonomous driving simulation system and used for various evaluation cases. The results of using our system in some simulation cases and the feedback from involved domain experts confirm the usefulness and efficiency of our method in helping people gain in-depth insight into autonomous driving systems.

The Visual Representation and Acquisition of Driving Knowledge for Autonomous Vehicle

Research on Management System of Automatic Driver Decision-Making Knowledge Base for Unmanned Vehicle

Knowledge Distillation on Driving Intention Generator: Learn Human-like Semantic Reasoning.

Towards Knowledge-driven Autonomous Driving

A Shared Control Approach for Autonomous Vehicles via Driver Behaviors Learning

Researches on Expert System for Automatic Driving Traffic Rules of Unmanned Vehicle

Human-vehicle Cooperative Visual Perception for Autonomous Driving under Complex Road and Traffic Scenarios

Technology and Application of Intelligent Driving Based on Visual Perception

Visual Evaluation for Autonomous Driving

Attention-Based Deep Driving Model for Autonomous Vehicles with Surround-View Cameras

Ontology-Based Driving Scene Modeling, Situation Assessment and Decision Making for Autonomous Vehicles.

Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles

Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving

DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models

VTD: Visual and Tactile Database for Driver State and Behavior Perception

An overview of the development of key technologies in autonomous driving technology

DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving

Unsupervised Real-to-Virtual Domain Unification for End-to-End Highway Driving.

World knowledge-enhanced Reasoning Using Instruction-guided Interactor in Autonomous Driving

Enhancing scene understanding based on deep learning for end-to-end autonomous driving

An Expository Examination of Temporally Evolving Graph-Based Approaches for the Visual Investigation of Autonomous Driving