Monitoring Misuse for Accountable 'Artificial Intelligence as a Service'

Seyyed Ahmad Javadi,Richard Cloete,Jennifer Cobbe,Michelle Seng Ah Lee,Jatinder Singh

DOI: https://doi.org/10.48550/arXiv.2001.09723

2020-01-15

Abstract:AI is increasingly being offered 'as a service' (AIaaS). This entails service providers offering customers access to pre-built AI models and services, for tasks such as object recognition, text translation, text-to-voice conversion, and facial recognition, to name a few. The offerings enable customers to easily integrate a range of powerful AI-driven capabilities into their applications. Customers access these models through the provider's APIs, sending particular data to which models are applied, the results of which returned. However, there are many situations in which the use of AI can be problematic. AIaaS services typically represent generic functionality, available 'at a click'. Providers may therefore, for reasons of reputation or responsibility, seek to ensure that the AIaaS services they offer are being used by customers for 'appropriate' purposes. This paper introduces and explores the concept whereby AIaaS providers uncover situations of possible service misuse by their customers. Illustrated through topical examples, we consider the technical usage patterns that could signal situations warranting scrutiny, and raise some of the legal and technical challenges of monitoring for misuse. In all, by introducing this concept, we indicate a potential area for further inquiry from a range of perspectives.

Computers and Society

What problem does this paper attempt to address?

The problem that this paper attempts to solve is "How to improve the accountability of 'Artificial Intelligence as a Service' (AIaaS) through monitoring". With the popularization of AIaaS, service providers offer many pre - built AI models and services, enabling customers to easily integrate powerful AI capabilities into their applications. However, these services may also be used for inappropriate purposes, such as population monitoring, invasion of personal privacy, etc. Therefore, the paper explores how AIaaS providers can detect possible service abuse situations by monitoring customers' usage patterns to ensure that these services are used for "appropriate" purposes. This not only helps maintain the provider's reputation, but also helps ensure that customers' use complies with the service terms, principles or requirements.

The paper proposes a conceptual framework to detect potential abuse situations by analyzing information sources such as transaction data, by - products of request processing and derivative data. For example, a high - frequency of face recognition requests may indicate large - scale population monitoring activities; detecting a large number of faces in a single image or video may point to the analysis of crowds; a large number of identification attempts on a specific individual may pose a threat to personal privacy; detecting "blacklist" objects may indicate controversial applications. In addition, the paper also discusses the possibility of detecting abuse through behavior patterns, such as using anomaly detection methods to identify behaviors that deviate from normal usage patterns.

In conclusion, the paper aims to explore the concept of AIaaS monitoring to promote greater supervision and governance of AIaaS use, while pointing out the legal and technical challenges in this process.