Abstract:The privacy of social media users is a major concern when the users share their content to the public. Sensitive information such as the location of the users can be inferred from relevant content without arising the awareness of the users. With blooming services provided by social media platforms, the users have more freedom to share information via diverse data formats. The multi-modality of the shared information may, in return, worsen the private information leakage caused by inference attacks. In this paper, we first examine the problem of location inference on multi-modal data comprised of textual information and visual content. It is observed that the visual content, such as photos shared by social media users, can significantly boost the success rate of location inference. To thwart adversaries who are driven by visual-related data, we propose a defence that mitigates the threat of location privacy breach under an imperceptible utility loss. Our defence, namely LocGuard, perturbs the photos in a one-off manner before sharing them. The perturbations, along with a simple but effective bipartite perturbation strategy, ensure that LocGuard is resistant to adaptive adversaries who can perform adversarial training based on the perturbed photos. Moreover, LocGuard remains effective against open-set adversaries whose data categories in the training dataset are hidden from the defender. In the evaluation, we conduct extensive experiments based on real-world datasets and compare our work with previous methods. The results show that LocGuard significantly outperforms the existing defences. In particular, LocGuard not only achieves better privacy protection and utility preservation for image sharing, but also can effectively defend against adversarial-training-capable attackers.

Where to be wary: The impact of widespread photo-taking and image enhancement practices on users' geo-privacy

A User Study on the Capability of Three Geo-Based Features in Analyzing and Locating Trajectories

LocGuard: A Location Privacy Defender for Image Sharing

X-Region: A Framework for Location Privacy Preservation in Mobile Peer-to-peer Networks

"Do You Know You Are Tracked by Photos That You Didn't Take": Location-Aware Multi-Party Image Privacy Protection

Privacy Risk Assessment on Online Photos.

Privacy risk in GeoData: A survey

GeoLocator: a location-integrated large multimodal model for inferring geo-privacy

POP: Privacy-Preserving Outsourced Photo Sharing and Searching for Mobile Devices

Recessive Social Networking: Preventing Privacy Leakage against Reverse Image Search

Preserving Location-Related Privacy Collaboratively in Geo-Social Networks

PrivateGaze: Preserving User Privacy in Black-box Mobile Gaze Tracking Services

Towards Privacy-Preserving and Practical Image-Centric Social Discovery

Visual Content Privacy Leaks on Social Media Networks

Exploring the Effectiveness of Geomasking Techniques for Protecting the Geoprivacy of Twitter Users

Enable Portrait Privacy Protection in Photo Capturing and Sharing

Towards a Visual Privacy Advisor: Understanding and Predicting Privacy Risks in Images

IEye: Personalized Image Privacy Detection

Where you go is who you are -- A study on machine learning based semantic privacy attacks

Who clicks there!: Anonymizing the photographer in a camera saturated society

Granular Privacy Control for Geolocation with Vision Language Models