Abstract:There has been a rise in the use of Machine Learning as a Service (MLaaS) Vision APIs as they offer multiple services including pre-built models and algorithms, which otherwise take a huge amount of resources if built from scratch. As these APIs get deployed for high-stakes applications, it's very important that they are robust to different manipulations. Recent works have only focused on typical adversarial attacks when evaluating the robustness of vision APIs. We propose two new aspects of adversarial image generation methods and evaluate them on the robustness of Google Cloud Vision API's optical character recognition service and object detection APIs deployed in real-world settings such as <a class="link-external link-http" href="http://sightengine.com" rel="external noopener nofollow">this http URL</a>, <a class="link-external link-http" href="http://picpurify.com" rel="external noopener nofollow">this http URL</a>, Google Cloud Vision API, and Microsoft Azure's Computer Vision API. Specifically, we go beyond the conventional small-noise adversarial attacks and introduce secret embedding and transparent adversarial examples as a simpler way to evaluate robustness. These methods are so straightforward that even non-specialists can craft such attacks. As a result, they pose a serious threat where APIs are used for high-stakes applications. Our transparent adversarial examples successfully evade state-of-the art object detections APIs such as Azure Cloud Vision (attack success rate 52%) and Google Cloud Vision (attack success rate 36%). 90% of the images have a secret embedded text that successfully fools the vision of time-limited humans but is detected by Google Cloud Vision API's optical character recognition. Complementing to current research, our results provide simple but unconventional methods on robustness evaluation.

Generation and Countermeasures of adversarial examples on vision: a survey

Research Progress and Challenges on Application-Driven Adversarial Examples: A Survey

Adversarial Examples on Object Recognition: A Comprehensive Survey

Adversarial Examples in Modern Machine Learning: A Review

Adversarial Examples based on Object Detection tasks: A Survey

Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey

A Survey of Practical Adversarial Example Attacks

Simple Transparent Adversarial Examples

Survey of Research Progress on Adversarial Examples in Images

How Can We Deal with Adversarial Examples?

Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey

Adversarial Examples: Opportunities and Challenges

Adversarial examples: A survey of attacks and defenses in deep learning-enabled cybersecurity systems

Adversarial Attacks and Defenses in Images, Graphs and Text: A Review

Security Matters: A Survey on Adversarial Machine Learning

Adversarial Examples: Attacks and Defenses for Deep Learning

A Survey and Evaluation of Adversarial Attacks for Object Detection

Adversarial Machine Learning for Cybersecurity and Computer Vision: Current Developments and Challenges

Interpreting Adversarial Examples in Deep Learning: A Review

Adversarial Attack and Defense: A Survey