Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness

David Fernández Llorca,Ronan Hamon,Henrik Junklewitz,Kathrin Grosse,Lars Kunze,Patrick Seiniger,Robert Swaim,Nick Reed,Alexandre Alahi,Emilia Gómez,Ignacio Sánchez,Akos Kriston

2024-02-21

Abstract:This study explores the complexities of integrating Artificial Intelligence (AI) into Autonomous Vehicles (AVs), examining the challenges introduced by AI components and the impact on testing procedures, focusing on some of the essential requirements for trustworthy AI. Topics addressed include the role of AI at various operational layers of AVs, the implications of the EU's AI Act on AVs, and the need for new testing methodologies for Advanced Driver Assistance Systems (ADAS) and Automated Driving Systems (ADS). The study also provides a detailed analysis on the importance of cybersecurity audits, the need for explainability in AI decision-making processes and protocols for assessing the robustness and ethical behaviour of predictive systems in AVs. The paper identifies significant challenges and suggests future directions for research and development of AI in AV technology, highlighting the need for multidisciplinary expertise.

Computers and Society,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The problems that this paper attempts to solve mainly focus on the complexity and challenges faced in integrating artificial intelligence (AI) into autonomous vehicles (AVs). Specifically, the paper explores the following aspects:

1. **The Role of AI in AVs**: The paper analyzes the role of AI at different operational levels of AVs, including positioning, perception (and prediction), planning, control, human - vehicle interaction, and system management. Each part of these levels is crucial for the safe operation of the vehicle, and the application of AI makes these functions more intelligent and efficient, but it also brings new uncertainties.

2. **Regulatory Impact**: The paper discusses the impact of the EU AI Act on AVs, especially how to define the classification criteria for high - risk AI systems and its potential requirements for vehicle safety components. The AI Act aims to ensure the credibility of AI systems through requirements in aspects such as risk management, data governance, technical documentation, record - keeping, transparency, information provision to users, human supervision, accuracy, robustness, and cybersecurity.

3. **The Need for Testing Methods**: With the development of AI technology, traditional testing methods may no longer be applicable. The paper emphasizes the need to develop new testing methods to evaluate the safety and reliability of advanced driver - assistance systems (ADAS) and autonomous driving systems (ADS). This includes the interpretability of the AI decision - making process, the robustness evaluation of prediction systems, and considerations of fairness.

4. **The Importance of Multidisciplinary Collaboration**: To address the above challenges, the paper points out that cross - disciplinary expertise and in - depth analysis are required. By combining the opinions of experts from different fields, a more comprehensive understanding of the application of AI in AV technology can be achieved, and the key directions for future research and development can be identified.

In summary, the main purpose of this paper is to explore the challenges brought by the application of AI in AVs and propose directions for future research to promote the healthy development of AI technology in the field of autonomous driving.