The Controllability of Planning, Responsibility, and Security in Automatic Driving Technology

Dan Wan,Hao Zhan

DOI: https://doi.org/10.48550/arXiv.2102.00617

2021-02-01

Abstract:People hope automated driving technology is always in a stable and controllable state; specifically, it can be divided into controllable planning, controllable responsibility, and controllable information. When this controllability is undermined, it brings about the problems, e.g., trolley dilemma, responsibility attribution, information leakage, and security. This article discusses these three types of issues separately and clarifies the misunderstandings.

Artificial Intelligence

What problem does this paper attempt to address?

This paper attempts to solve three main problems in autonomous driving technology to ensure that this technology can always be in a stable and controllable state. Specifically, these three problems are:

1. **Controllable Planning**:
- Representative problem: Trolley Problem
- The paper discusses how the system makes ethical decisions in the face of inevitable accidents in the autonomous driving scenario. For example, when facing the trolley problem, the system needs to decide whether to sacrifice the few or the many. The author points out that since the automatic system must presuppose some kind of loss, in some cases, the system may make decisions that sacrifice human lives, which is ethically unacceptable. The paper further explores how to solve this problem by excluding "loss prediction".

2. **Controllable Responsibility**:
- Representative problem: Problem of liability attribution
- The paper discusses how to determine accident liability under different automation levels (from L0 to L5). Especially at the L3 level, that is, in the case of conditional automation, the problem of liability attribution is particularly complex due to the unclear division of responsibilities between the system and the driver. The paper proposes two solutions: one is to attribute the responsibility to the driver; the other is to skip L3 and directly develop L4 or L5 - level technologies to avoid the problem of liability division.

3. **Controllable Security**:
- Representative problem: Information leakage and cyber - attacks
- The paper discusses the information leakage and network security problems that the autonomous driving system may face in the online state. In terms of information leakage, although autonomous vehicles will collect a large amount of data, these problems are not unique to autonomous driving, but are part of the Internet information privacy problem. In terms of network security, the paper emphasizes the special risks faced by the autonomous driving system, such as attacks without physical contact, multiple vehicles being damaged simultaneously, and attacks being difficult to detect. The paper also introduces several defense measures, including passive defense (such as feature compression and randomization operations) and active defense (such as training more robust models).

Overall, the paper aims to make autonomous driving technology more controllable and safer at the ethical, legal and technical levels by clarifying these misunderstandings and proposing solutions.