Data-Driven Security Analysis of Machine Learning Systems

Chao Shen

DOI: https://doi.org/10.1109/NaNA51271.2020.00008

2020-01-01

Abstract:Human society is witnessing a wave of machine learning(ML) driven by dep learning techniques, bringing a technological revolution for human production and life. In some specific fields, ML achieved or even surpassed human-level performance. However, most previous machine learning theories have not considered the open and even adversarial environments, and the security and privacy issues are gradually rising. Besides of insecure code implementations, blased models, adversarial examples, sensor spoofing can also lead to security risks, which are hard to be discovered by traditional security analysis tools. This talk reviews previous works on ML system security and privacy, revealing potential security and privacy risks. Firstly, we introduce a threat model of ML systems, including attack surfaces, attach capabilitiesand attack goals. Second, we analyze security risks and countermeasures in terms of four critical components in ML systems: data input (sensor), data preprocessing, machine learning model and output. Finally, we discuss future research trends on the security of ML systems. The aim si to arise the attention of the computer security society and the ML society on security and privacy of ML systems, and so that they can work together to unlock ML's potential to build a bright future.