Trustworthy AI Inference Systems: An Industry Research View
Rosario Cammarota,Matthias Schunter,Anand Rajan,Fabian Boemer,Ágnes Kiss,Amos Treiber,Christian Weinert,Thomas Schneider,Emmanuel Stapf,Ahmad-Reza Sadeghi,Daniel Demmler,Joshua Stock,Huili Chen,Siam Umar Hussain,Sadegh Riazi,Farinaz Koushanfar,Saransh Gupta,Tajan Simunic Rosing,Kamalika Chaudhuri,Hamid Nejatollahi,Nikil Dutt,Mohsen Imani,Kim Laine,Anuj Dubey,Aydin Aysu,Fateme Sadat Hosseini,Chengmo Yang,Eric Wallace,Pamela Norton
DOI: https://doi.org/10.48550/arXiv.2008.04449
2023-02-10
Abstract:In this work, we provide an industry research view for approaching the design, deployment, and operation of trustworthy Artificial Intelligence (AI) inference systems. Such systems provide customers with timely, informed, and customized inferences to aid their decision, while at the same time utilizing appropriate security protection mechanisms for AI models. Additionally, such systems should also use Privacy-Enhancing Technologies (PETs) to protect customers' data at any time. To approach the subject, we start by introducing current trends in AI inference systems. We continue by elaborating on the relationship between Intellectual Property (IP) and private data protection in such systems. Regarding the protection mechanisms, we survey the security and privacy building blocks instrumental in designing, building, deploying, and operating private AI inference systems. For example, we highlight opportunities and challenges in AI systems using trusted execution environments combined with more recent advances in cryptographic techniques to protect data in use. Finally, we outline areas of further development that require the global collective attention of industry, academia, and government researchers to sustain the operation of trustworthy AI inference systems.
Cryptography and Security,Artificial Intelligence,Hardware Architecture,Computers and Society,Machine Learning