Towards AI Forensics: Did the Artificial Intelligence System Do It?

Johannes Schneider,Frank Breitinger
DOI: https://doi.org/10.48550/arXiv.2005.13635
2023-08-11
Abstract:Artificial intelligence (AI) makes decisions impacting our daily lives in an increasingly autonomous manner. Their actions might cause accidents, harm, or, more generally, violate regulations. Determining whether an AI caused a specific event and, if so, what triggered the AI's action, are key forensic questions. We provide a conceptualization of the problems and strategies for forensic investigation. We focus on AI that is potentially ``malicious by design'' and grey box analysis. Our evaluation using convolutional neural networks illustrates challenges and ideas for identifying malicious AI.
Artificial Intelligence,Cryptography and Security
What problem does this paper attempt to address?