Abstract:There has been a rise in the use of Machine Learning as a Service (MLaaS) Vision APIs as they offer multiple services including pre-built models and algorithms, which otherwise take a huge amount of resources if built from scratch. As these APIs get deployed for high-stakes applications, it's very important that they are robust to different manipulations. Recent works have only focused on typical adversarial attacks when evaluating the robustness of vision APIs. We propose two new aspects of adversarial image generation methods and evaluate them on the robustness of Google Cloud Vision API's optical character recognition service and object detection APIs deployed in real-world settings such as <a class="link-external link-http" href="http://sightengine.com" rel="external noopener nofollow">this http URL</a>, <a class="link-external link-http" href="http://picpurify.com" rel="external noopener nofollow">this http URL</a>, Google Cloud Vision API, and Microsoft Azure's Computer Vision API. Specifically, we go beyond the conventional small-noise adversarial attacks and introduce secret embedding and transparent adversarial examples as a simpler way to evaluate robustness. These methods are so straightforward that even non-specialists can craft such attacks. As a result, they pose a serious threat where APIs are used for high-stakes applications. Our transparent adversarial examples successfully evade state-of-the art object detections APIs such as Azure Cloud Vision (attack success rate 52%) and Google Cloud Vision (attack success rate 36%). 90% of the images have a secret embedded text that successfully fools the vision of time-limited humans but is detected by Google Cloud Vision API's optical character recognition. Complementing to current research, our results provide simple but unconventional methods on robustness evaluation.

The Human Visual System and Adversarial AI

Adversarial Computer Vision Via Acoustic Manipulation of Camera Sensors

Dual Thinking and Perceptual Analysis of Deep Learning Models using Human Adversarial Examples

Overcoming Adversarial Attacks for Human-in-the-Loop Applications

Physical Adversarial Attack meets Computer Vision: A Decade Survey

Adversarial Examples that Fool both Computer Vision and Time-Limited Humans

Perceptually Constrained Adversarial Attacks

Adversarial images for the primate brain

State-of-the-art optical-based physical adversarial attacks for deep learning computer vision systems

Simple Transparent Adversarial Examples

Strengthening Robustness Under Adversarial Attacks Using Brain Visual Codes

On the Suitability of $L_p$-norms for Creating and Preventing Adversarial Examples

Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey

Visible Light-Based Human Visual System Conceptual Model

Adversarial Machine Learning for Cybersecurity and Computer Vision: Current Developments and Challenges

Visual Analysis of Adversarial Examples in Machine Learning

Adversarial Attacks Hidden in Plain Sight

Unadversarial Examples: Designing Objects for Robust Vision

Towards Human-Leveled Vision Systems

A Review of Adversarial Attacks in Computer Vision