Transparency, Compliance, And Contestability When Code Is(n't) Law

Alexander Hicks

DOI: https://doi.org/10.1145/3584318.3584854

2022-09-28

Abstract:Both technical security mechanisms and legal processes serve as mechanisms to deal with misbehaviour according to a set of norms. While they share general similarities, there are also clear differences in how they are defined, act, and the effect they have on subjects. This paper considers the similarities and differences between both types of mechanisms as ways of dealing with misbehaviour, and where they interact with each other. Taking into consideration the idea of code as law, we discuss accountability mechanisms for code, and how they must relate to both security principles and legal principles. In particular, we identify the ability to contest norms enforced by code as an important part of accountability in this context. Based on this analysis, we make the case for transparency enhancing technologies as security mechanisms that can support legal processes, in contrast to other types of accountability mechanisms for code. We illustrate this through two examples based on recent court cases that involved Post Office in the United Kingdom and Uber in the Netherlands, and discuss some practical considerations.

Computers and Society,Cryptography and Security

What problem does this paper attempt to address?

The problem that this paper attempts to solve is, in computer systems, how code, as part of the law, can support the legal process through security mechanisms such as transparency - enhancing techniques to deal with possible misbehaviors or harms when code enforces norms. Specifically, the paper explores the similarities and differences between technical security mechanisms and legal procedures as ways of dealing with misbehaviors, and emphasizes the importance of ensuring code accountability mechanisms in the context where code is regarded as law, especially how these mechanisms are related to security principles and legal principles. The paper specifically points out that the ability to question the norms that can be enforced on code is an important part of accountability in this context.

The paper also proposes the view that transparency - enhancing techniques, as security mechanisms, can support the legal process, in contrast to other forms of code accountability mechanisms (such as compliance - based audits). Through two examples based on recent court cases - the UK Post Office and Uber in the Netherlands, the paper further illustrates this point and discusses some practical considerations. These considerations include electronic evidence, balancing transparency and privacy, and in which aspects of system actions transparency should be implemented. In summary, the paper aims to explore how to improve the transparency and accountability of code through technical means, thereby better protecting the rights of individuals affected by code - enforced norms.