Abstract:The soaring number of personal mobile devices and public cameras poses a threat to fundamental human rights and ethical principles. For example, the stolen of private information such as face image by malicious third parties will lead to catastrophic consequences. By manipulating appearance of face in the image, most of existing protection algorithms are effective but irreversible. Here, we propose a practical and systematic solution to invertiblely protect face information in the full-process pipeline from camera to final users. Specifically, We design a novel lightweight Flow-based Face Encryption Method (FFEM) on the local embedded system privately connected to the camera, minimizing the risk of eavesdropping during data transmission. FFEM uses a flow-based face encoder to encode each face to a Gaussian distribution and encrypts the encoded face feature by random rotating the Gaussian distribution with the rotation matrix is as the password. While encrypted latent-variable face images are sent to users through public but less reliable channels, password will be protected through more secure channels through technologies such as asymmetric encryption, blockchain, or other sophisticated security schemes. User could select to decode an image with fake faces from the encrypted image on the public channel. Only trusted users are able to recover the original face using the encrypted matrix transmitted in secure channel. More interestingly, by tuning Gaussian ball in latent space, we could control the fairness of the replaced face on attributes such as gender and race. Extensive experiments demonstrate that our solution could protect privacy and enhance fairness with minimal effect on high-level downstream task.

Hiding from Facebook: An Encryption Protocol resistant to Correlation Attacks

Image Encryption Algorithm Based on Facebook Social Network

Face Search in Encrypted Domain.

CryptoMask : Privacy-preserving Face Recognition

A Privacy-Preserving Friend Matching Scheme Based on Attribute Encryption in Mobile Social Networks

Progressive Scrambling for Social Media

Recessive Social Networking: Preventing Privacy Leakage against Reverse Image Search

DuetFace: Collaborative Privacy-Preserving Face Recognition via Channel Splitting in the Frequency Domain

Can we still avoid automatic face detection?

De anonymizability of social network: through the lens of symmetry

People Taking Photos That Faces Never Share: Privacy Protection and Fairness Enhancement from Camera to User

Password Correlation: Quantification, Evaluation and Application.

Attribute-Guided Encryption with Facial Texture Masking

Steganography in Social Networks Based on Behavioral Correlation

Leveraging deep learning-assisted attacks against image obfuscation via federated learning

Reversible Privacy-Preserving Recognition.

PRO-Face C: Privacy-Preserving Recognition of Obfuscated Face via Feature Compensation

One Password: An Encryption Scheme for Hiding Users' Register Information

Investigating Privacy Attacks in the Gray-Box Setting to Enhance Collaborative Learning Schemes

EFR-CSTP: Encryption for Face Recognition Based on the Chaos and Semi-tensor Product Theory

Crypto-Nets: Neural Networks over Encrypted Data