Abstract:The privacy of social media users is a major concern when the users share their content to the public. Sensitive information such as the location of the users can be inferred from relevant content without arising the awareness of the users. With blooming services provided by social media platforms, the users have more freedom to share information via diverse data formats. The multi-modality of the shared information may, in return, worsen the private information leakage caused by inference attacks. In this paper, we first examine the problem of location inference on multi-modal data comprised of textual information and visual content. It is observed that the visual content, such as photos shared by social media users, can significantly boost the success rate of location inference. To thwart adversaries who are driven by visual-related data, we propose a defence that mitigates the threat of location privacy breach under an imperceptible utility loss. Our defence, namely LocGuard, perturbs the photos in a one-off manner before sharing them. The perturbations, along with a simple but effective bipartite perturbation strategy, ensure that LocGuard is resistant to adaptive adversaries who can perform adversarial training based on the perturbed photos. Moreover, LocGuard remains effective against open-set adversaries whose data categories in the training dataset are hidden from the defender. In the evaluation, we conduct extensive experiments based on real-world datasets and compare our work with previous methods. The results show that LocGuard significantly outperforms the existing defences. In particular, LocGuard not only achieves better privacy protection and utility preservation for image sharing, but also can effectively defend against adversarial-training-capable attackers.

Rethinking Adversarial Examples for Location Privacy Protection

Spot evasion attacks: Adversarial examples for license plate recognition systems with convolutional neural networks

LocGuard: A Location Privacy Defender for Image Sharing

RA-RevGAN: Region-Aware Reversible Adversarial Example Generation Network for Privacy-Preserving Applications

Dual Protection for Image Privacy and Copyright Via Traceable Adversarial Examples

Exploiting vulnerabilities of deep neural networks for privacy protection

Adversarial Training against Location-Optimized Adversarial Patches

Adversarial Examples in Remote Sensing

Multiclass ASMA vs Targeted PGD Attack in Image Segmentation

Using an ensemble color space model to tackle adversarial examples

Transferable Adversarial Attack on Image Tampering Localization

Adversarial Examples Detection Beyond Image Space.

Leveraging Adversarial Examples to Quantify Membership Information Leakage

Visual Privacy Protection via Mapping Distortion

Adversarial Image Generation by Spatial Transformation in Perceptual Colorspaces

Adversarial Learning of Privacy-Preserving and Task-Oriented Representations

Defense against adversarial attacks based on color space transformation

Adversarial Examples in Visual Object Tracking in Satellite Videos: Cross-Frame Momentum Accumulation for Adversarial Examples Generation

Detecting Localized Adversarial Examples: A Generic Approach Using Critical Region Analysis

Defense Against Adversarial Attacks via Controlling Gradient Leaking on Embedded Manifolds

Local Adversarial Attacks for Understanding Model Decisions.