Convergence of Realistic Projection and Reflection Methods

J. Borwein,B. Sims,Matthew K. Tam

Abstract:We provide sufficient conditions for norm convergence of various projection and reflection methods, as well as giving limiting examples regarding convergence rates.

What problem does this paper attempt to address?

Privacy-Preserving Face Recognition Using Random Frequency Components

Yuxi Mi,Yuge Huang,Jiazhen Ji,Minyi Zhao,Jiaxiang Wu,Xingkun Xu,Shouhong Ding,Shuigeng Zhou

2023-08-21

Abstract:The ubiquitous use of face recognition has sparked increasing privacy concerns, as unauthorized access to sensitive face images could compromise the information of individuals. This paper presents an in-depth study of the privacy protection of face images' visual information and against recovery. Drawing on the perceptual disparity between humans and models, we propose to conceal visual information by pruning human-perceivable low-frequency components. For impeding recovery, we first elucidate the seeming paradox between reducing model-exploitable information and retaining high recognition accuracy. Based on recent theoretical insights and our observation on model attention, we propose a solution to the dilemma, by advocating for the training and inference of recognition models on randomly selected frequency components. We distill our findings into a novel privacy-preserving face recognition method, PartialFace. Extensive experiments demonstrate that PartialFace effectively balances privacy protection goals and recognition accuracy. Code is available at: <a class="link-external link-https" href="https://github.com/Tencent/TFace" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Local Features Meet Stochastic Anonymization: Revolutionizing Privacy-Preserving Face Recognition for Black-Box Models

Yuanwei Liu,Chengyu Jia,Ruqi Xiao,Xuemai Jia,Hui Wei,Kui Jiang,Zheng Wang

2024-12-11

Abstract:The task of privacy-preserving face recognition (PPFR) currently faces two major unsolved challenges: (1) existing methods are typically effective only on specific face recognition models and struggle to generalize to black-box face recognition models; (2) current methods employ data-driven reversible representation encoding for privacy protection, making them susceptible to adversarial learning and reconstruction of the original image. We observe that face recognition models primarily rely on local features ({e.g., face contour, skin texture, and so on) for identification. Thus, by disrupting global features while enhancing local features, we achieve effective recognition even in black-box environments. Additionally, to prevent adversarial models from learning and reversing the anonymization process, we adopt an adversarial learning-based approach with irreversible stochastic injection to ensure the stochastic nature of the anonymization. Experimental results demonstrate that our method achieves an average recognition accuracy of 94.21\% on black-box models, outperforming existing methods in both privacy protection and anti-reconstruction capabilities.

Computer Vision and Pattern Recognition
Reversible Privacy-Preserving Recognition.

Zhengxin You,Sheng Li,Zhenxing Qian,Xinpeng Zhang

DOI: https://doi.org/10.1109/icme51207.2021.9428115

2021-01-01

Abstract:In this paper, we propose a novel reversible face privacy-preserving scheme. Before uploading facial images onto the cloud, we first cover the facial region with mosaic and train an encoder to generate protected images with original facial information embedded. We train another classifier with protected images for facial expression recognition and a decoder for recovering original facial images. On the cloud service, protected images provide little identity information to malicious attackers. For low-privileged users, they can use the provided classifier to do computer vision tasks with protected images. For authorized users, after content recovery, the nor-mal usage of the facial images will not be affected. Experimental results show that the proposed method is effective in facial images recovery. In addition, the protected images can maintain similar accuracy on typical computer vision tasks compared to the original images.
Privacy-Preserving Face Recognition Using Trainable Feature Subtraction

Yuxi Mi,Zhizhou Zhong,Yuge Huang,Jiazhen Ji,Jianqing Xu,Jun Wang,Shaoming Wang,Shouhong Ding,Shuigeng Zhou

2024-03-19

Abstract:The widespread adoption of face recognition has led to increasing privacy concerns, as unauthorized access to face images can expose sensitive personal information. This paper explores face image protection against viewing and recovery attacks. Inspired by image compression, we propose creating a visually uninformative face image through feature subtraction between an original face and its model-produced regeneration. Recognizable identity features within the image are encouraged by co-training a recognition model on its high-dimensional feature representation. To enhance privacy, the high-dimensional representation is crafted through random channel shuffling, resulting in randomized recognizable images devoid of attacker-leverageable texture details. We distill our methodologies into a novel privacy-preserving face recognition method, MinusFace. Experiments demonstrate its high recognition accuracy and effective privacy protection. Its code is available at

Computer Vision and Pattern Recognition
A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Haonan Chen,Yaowu Chen,Xiang Tian,Rongxin Jiang

DOI: https://doi.org/10.1109/access.2019.2955383

IF: 3.9

2019-01-01

IEEE Access

Abstract:In consideration of secure and convenient, face gains increasing attention in variety of fields during the past decades. Since human face is most accessible from our daily life and preserves the richest information, face based biometric systems are widely used in person authentication applications. However, face recognition systems are always challenged by face spoofing attacks. Although, researchers have proposed many face spoofing detection methods, which have achieved great performances, we aim to develop a method to counter face spoofing, which combines the face detection stage and face spoofing detection stage together. In this paper, we design face anti-spoofing region-based convolutional neural network (FARCNN), based on improved Faster region-based convolutional neural network (R-CNN) framework. Motivated by face detection, we regard the face spoofing detection as a three-way classification to distinguish real face, fake face and background. We extend the typical Faster R-CNN scheme by optimizing several important strategies, including roi-pooling feature fusion and adding Crystal Loss function to the original multi-task loss function. In addition, an improved Retinex based LBP is presented to handle the different illumination conditions in face spoofing detection. Finally, these two detectors are further cascaded and achieve promising performances on the benchmark databases: CASIA-FASD, REPLAY-ATTACK and OULU-NPU. Besides, for the purpose of verifying the generalization capacity of the proposed cascade detector, we perform experiments on cross-databases and the results testify the effectiveness of our proposed method.
High Resolution Face Privacy-Enhancing Method Based on Latent Optimization with Identity-Preserving Facial Masking

Haoxuan Tai,Yang Zhang,Bofei Guo,Guibo Luo,Yuesheng Zhu

DOI: https://doi.org/10.1109/ijcnn60899.2024.10650935

2024-01-01

Abstract:The widespread application of face recognition technology easily leads to the leakage of facial soft biometric privacy. Therefore, image-level face privacy-enhancing methods for face recognition scenarios aim to remove soft biometric privacy information while preserving individual identity. Existing methods suffer from performance degradation in face recognition and poor quality in privacy-enhanced images when processing high-resolution images, often resulting in artifacts and complexity in model optimization. To address these issues, we propose an identity-preserving face privacy-enhancing method based on latent optimization and face masking for high-resolution images. The proposed method generates privacy-enhanced faces by optimizing latent codes and mask blending, without relying on a well-defined encoder-decoder structure, making it more suitable for processing high-resolution images. We introduce a face masking strategy and design a facial elements identity influence prioritization module to adaptively select privacy-enhancing facial parts and attributes. As a result, the proposed method can protect multiple facial privacy attributes while improving the quality of generated images and maintaining face recognizability. Extensive experiments on two benchmark datasets demonstrate the effectiveness of the proposed method in anonymizing visual appearances for high-resolution face images while maintaining superior face recognition performance and image quality.
Privacy-preserving face recognition method based on extensible feature extraction

Weitong Hu,Di Zhou,Zhenxin Zhu,Tong Qiao,Ye Yao,Mahmoud Hassaballah

DOI: https://doi.org/10.1016/j.jvcir.2024.104140

IF: 2.887

2024-04-10

Journal of Visual Communication and Image Representation

Abstract:Face recognition (FR) technique has become a pervasive and ubiquitous part of daily lives, from unlocking our smartphones with a glance to being scanned by surveillance cameras in various outdoor locations. When people's face photos are uploaded to the cloud for face recognition processing, they often have legitimate concerns about the privacy and security of their biometric data. A number of privacy-preserving face recognition (PPFR) frameworks have been proposed to address these issues by enabling the cloud to perform face recognition without revealing the identity or features of the face photos. However, these frameworks suffer from several limitations. They rely on computationally intensive operations that increase the cost and time of face recognition, leading to less applications in the real-world scenario. Many current frameworks support only one face recognition method and cannot be extended to different models. To overcome these challenges, in this paper, we propose a PPFR framework with high recognition accuracy based on extensible feature extraction for different application scenarios. In particular, features are extracted by a selective model, such as MobileFaceNet, ResNet-18 or ResNet-50, and encrypted by a randomness-based encryption algorithm in both face owner and user. Cloud service provider (SP) performs face recognition by comparing the Euclidean distances between features received from the above two entities. Extensive experiments verify that the proposed framework has significant advantages in terms of accuracy and efficiency.

computer science, information systems, software engineering
Make Privacy Renewable! Generating Privacy-Preserving Faces Supporting Cancelable Biometric Recognition

Tao Wang,Yushu Zhang,Xiangli Xiao,Lin Yuan,Zhihua Xia,Jian Weng

DOI: https://doi.org/10.1145/3664647.3680704

2024-01-01

Abstract:The significant advancement in face recognition drives face privacy protection into a prominent research direction. Unlike de-identification, a recent class of face privacy protection schemes preserves identifiable formation for face recognition. However, these schemes fail to support the revocation of the leaked identity, causing attackers to potentially identify individuals and then pose security threats. In this paper, we explore the possibility of generating privacy-preserving faces (not features) supporting cancelable biometric recognition. Specifically, we propose a cancelable face generator (CanFG), which removes the physical identity for privacy protection and embeds the virtual identity for face recognition. Particularly, when leaked, the virtual identity can be revoked and renew as another one, preventing re-identification from attackers. Benefiting from the designed distance-preserving identity transformation, CanFG can guarantee separability and preserve recognizability of virtual identities. Moreover, to make CanFG lightweight, we design a simple but effective training strategy, which allows CanFG to require only one (rather than two) network for achieving stable multi-objective learning. Extensive experimental results and sufficient security analyses demonstrate the ability of CanFG to effectively protect physical identity and support cancelable biometric recognition. Our code is available at https://github.com/daizigege/CanFG.
Local Privacy Protection for Sensitive Areas in Multiface Images

Chao Liu,Jing Yang,Xuan Zhang,Yining Zhang,Weinan Zhao,Fengjuan Miao,Yukun Shao

DOI: https://doi.org/10.1155/2022/5919522

IF: 3.12

2022-03-15

Computational Intelligence and Neuroscience

Abstract:The privacy protection for face images aims to prevent attackers from accurately identifying target persons through face recognition. Inspired by goal-driven reasoning (reverse reasoning), this paper designs a goal-driven algorithm of local privacy protection for sensitive areas in multiface images (face areas) under the interactive framework of face recognition algorithm, regional growth, and differential privacy. The designed algorithm, named privacy protection for sensitive areas (PPSA), is realized in the following manner: Firstly, the multitask cascaded convolutional network (MTCNN) was adopted to recognize the region and landmark of each face. If the landmark overlaps a subgraph divided from the original image, the subgraph will be taken as the seed for regional growth in the face area, following the growth criterion of the fusion similarity measurement mechanism (FSMM). Different from single-face privacy protection, multiface privacy protection needs to deal with an unknown number of faces. Thus, the allocation of the privacy budget ε directly affects the operation effect of the PPSA algorithm. In our scheme, the total privacy budget ε is divided into two parts: ε_1 and ε_2. The former is evenly allocated to each seed, according to the estimated number of faces ρ contained in the image, while the latter is allocated to the other areas that may consume the privacy budget through dichotomization. Unlike the Laplacian (LAP) algorithm, the noise error of the PPSA algorithm will not change with the image size, for the privacy protection is limited to the face area. The results show that the PPSA algorithm meets the requirements ε-Differential privacy, and image classification is realized by using different image privacy protection algorithms in different human face databases. The verification results show that the accuracy of the PPSA algorithm is improved by at least 16.1%, the recall rate is improved by at least 2.3%, and F1-score is improved by at least 15.2%.

mathematical & computational biology,neurosciences
Privacy-Preserving Face Recognition in Hybrid Frequency-Color Domain

Dong Han,Yong Li,Joachim Denzler

2024-01-24

Abstract:Face recognition technology has been deployed in various real-life applications. The most sophisticated deep learning-based face recognition systems rely on training millions of face images through complex deep neural networks to achieve high accuracy. It is quite common for clients to upload face images to the service provider in order to access the model inference. However, the face image is a type of sensitive biometric attribute tied to the identity information of each user. Directly exposing the raw face image to the service provider poses a threat to the user's privacy. Current privacy-preserving approaches to face recognition focus on either concealing visual information on model input or protecting model output face embedding. The noticeable drop in recognition accuracy is a pitfall for most methods. This paper proposes a hybrid frequency-color fusion approach to reduce the input dimensionality of face recognition in the frequency domain. Moreover, sparse color information is also introduced to alleviate significant accuracy degradation after adding differential privacy noise. Besides, an identity-specific embedding mapping scheme is applied to protect original face embedding by enlarging the distance among identities. Lastly, secure multiparty computation is implemented for safely computing the embedding distance during model inference. The proposed method performs well on multiple widely used verification datasets. Moreover, it has around 2.6% to 4.2% higher accuracy than the state-of-the-art in the 1:N verification scenario.

Computer Vision and Pattern Recognition
PRO-Face C: Privacy-Preserving Recognition of Obfuscated Face via Feature Compensation

Lin Yuan,Wu Chen,Xiao Pu,Yan Zhang,Hongbo Li,Yushu Zhang,Xinbo Gao,Touradj Ebrahimi

DOI: https://doi.org/10.1109/tifs.2024.3388976

IF: 7.231

2024-05-10

IEEE Transactions on Information Forensics and Security

Abstract:The advancement of face recognition technology has delivered substantial societal advantages. However, it has also raised global privacy concerns due to the ubiquitous collection and potential misuse of individuals' facial data. This presents a notable paradox: while there is a societal demand for a robust face recognition ecosystem to ensure public security and convenience, an increasing number of individuals are hesitant to release their facial data. Numerous studies have endeavored to find such a utility-privacy trade-off, yet many struggle with the dilemma of prioritizing one at the expense of the other. In response to this challenge, this paper proposes PRO-Face C, a novel paradigm for privacy-preserving recognition of obfuscated faces via a dedicated feature compensation mechanism, aimed at optimizing the equilibrium between privacy preservation and utility maximization. The proposed approach is characterized by a specialized client-server architecture: the client transmits only obfuscated images to the server, which then performs identity recognition using a pre-trained model in conjunction with a suite of privacy-free complementary features. This framework facilitates accurate face identification while safeguarding the original facial appearance from explicit disclosure. Furthermore, the obfuscated image retains its visualization capability, crucial for image preview functionalities. To ensure the desired properties, we have developed an identity-guided feature compensation mechanism, complemented by several privacy-enhancing techniques. Extensive experiments conducted across multiple face datasets underscore the effectiveness of the proposed approach in diverse scenarios.

computer science, theory & methods,engineering, electrical & electronic
Transferable Adversarial Facial Images for Privacy Protection

Minghui Li,Jiangxiong Wang,Hao Zhang,Ziqi Zhou,Shengshan Hu,Xiaobing Pei

2024-07-18

Abstract:The success of deep face recognition (FR) systems has raised serious privacy concerns due to their ability to enable unauthorized tracking of users in the digital world. Previous studies proposed introducing imperceptible adversarial noises into face images to deceive those face recognition models, thus achieving the goal of enhancing facial privacy protection. Nevertheless, they heavily rely on user-chosen references to guide the generation of adversarial noises, and cannot simultaneously construct natural and highly transferable adversarial face images in black-box scenarios. In light of this, we present a novel face privacy protection scheme with improved transferability while maintain high visual quality. We propose shaping the entire face space directly instead of exploiting one kind of facial characteristic like makeup information to integrate adversarial noises. To achieve this goal, we first exploit global adversarial latent search to traverse the latent space of the generative model, thereby creating natural adversarial face images with high transferability. We then introduce a key landmark regularization module to preserve the visual identity information. Finally, we investigate the impacts of various kinds of latent spaces and find that $\mathcal{F}$ latent space benefits the trade-off between visual naturalness and adversarial transferability. Extensive experiments over two datasets demonstrate that our approach significantly enhances attack transferability while maintaining high visual quality, outperforming state-of-the-art methods by an average 25% improvement in deep FR models and 10% improvement on commercial FR APIs, including Face++, Aliyun, and Tencent.

Computer Vision and Pattern Recognition,Artificial Intelligence
Privacy-preserving Adversarial Facial Features

Zhibo Wang,He Wang,Shuaifan Jin,Wenwen Zhang,Jiahui Hu,Yan Wang,Peng Sun,Wei Yuan,Kaixin Liu,Kui Ren

DOI: https://doi.org/10.48550/arXiv.2305.05391

2023-05-08

Abstract:Face recognition service providers protect face privacy by extracting compact and discriminative facial features (representations) from images, and storing the facial features for real-time recognition. However, such features can still be exploited to recover the appearance of the original face by building a reconstruction network. Although several privacy-preserving methods have been proposed, the enhancement of face privacy protection is at the expense of accuracy degradation. In this paper, we propose an adversarial features-based face privacy protection (AdvFace) approach to generate privacy-preserving adversarial features, which can disrupt the mapping from adversarial features to facial images to defend against reconstruction attacks. To this end, we design a shadow model which simulates the attackers' behavior to capture the mapping function from facial features to images and generate adversarial latent noise to disrupt the mapping. The adversarial features rather than the original features are stored in the server's database to prevent leaked features from exposing facial information. Moreover, the AdvFace requires no changes to the face recognition network and can be implemented as a privacy-enhancing plugin in deployed face recognition systems. Extensive experimental results demonstrate that AdvFace outperforms the state-of-the-art face privacy-preserving methods in defending against reconstruction attacks while maintaining face recognition accuracy.

Computer Vision and Pattern Recognition
People Taking Photos That Faces Never Share: Privacy Protection and Fairness Enhancement from Camera to User

Junjie Zhu,Lin Gu,Xiaoxiao Wu,Zheng Li,Tatsuya Harada,Yingying Zhu

DOI: https://doi.org/10.1609/aaai.v37i12.26712

2023-06-26

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:The soaring number of personal mobile devices and public cameras poses a threat to fundamental human rights and ethical principles. For example, the stolen of private information such as face image by malicious third parties will lead to catastrophic consequences. By manipulating appearance of face in the image, most of existing protection algorithms are effective but irreversible. Here, we propose a practical and systematic solution to invertiblely protect face information in the full-process pipeline from camera to final users. Specifically, We design a novel lightweight Flow-based Face Encryption Method (FFEM) on the local embedded system privately connected to the camera, minimizing the risk of eavesdropping during data transmission. FFEM uses a flow-based face encoder to encode each face to a Gaussian distribution and encrypts the encoded face feature by random rotating the Gaussian distribution with the rotation matrix is as the password. While encrypted latent-variable face images are sent to users through public but less reliable channels, password will be protected through more secure channels through technologies such as asymmetric encryption, blockchain, or other sophisticated security schemes. User could select to decode an image with fake faces from the encrypted image on the public channel. Only trusted users are able to recover the original face using the encrypted matrix transmitted in secure channel. More interestingly, by tuning Gaussian ball in latent space, we could control the fairness of the replaced face on attributes such as gender and race. Extensive experiments demonstrate that our solution could protect privacy and enhance fairness with minimal effect on high-level downstream task.
Research on the Privacy Security of Face Recognition Technology

Luning Pang

DOI: https://doi.org/10.1155/2022/7882294

2022-01-25

Abstract:To solve the problem that privacy data are easy to leak in the application of face recognition technology in apps, a method which is based on differential privacy for privacy security protection is proposed. Firstly, Bayesian GAN is conducted to obtain the training data with the same distribution as the privacy data, and the algorithm of differential privacy is conducted to train the training data to obtain these labels with privacy protection. Then, based on the proposed lightface lightweight face recognition model, the tag with noise is generated, and the gradient descent is conducted on the recovered face feature vector from the attack. Finally, through the analysis of privacy loss, an accurate privacy protection boundary is provided. From the results of experiments, it could be known that the proposed privacy security protection method can effectively protect the parameter information of the face recognition model under the face recognition technology and reduce the recognition accuracy of the image recovered by the attacker. Compared with the privacy protection methods such as DPSGD and PATE, it has strong privacy protection ability and can be applied to the privacy protection of practical APP.
Privacy-Protected Facial Expression Recognition Augmented by High-Resolution Facial Images.

Cong Liang,Shangfei Wang,Xiaoping Chen

DOI: https://doi.org/10.1109/icme55011.2023.00236

2023-01-01

Abstract:Cloud-based expression recognition from high-resolution facial images may put the subjects' privacy at risk. We identify two kinds of privacy leakage, the appearance leakage in which the visual appearances of subjects are disclosed and the identity-pattern leakage in which the identity information of subjects is dug out. To address both leakages, we propose privacy-protected facial expression recognition from low-resolution facial images with the help of high-resolution facial images. Specifically, to prevent appearance leakage, we propose to extract identity-invariant representations from downsampled images, from which the visually distinguishable appearances cannot be recovered. To prevent identity-pattern leakage, we propose to eliminate the identity information from the extracted representations by leveraging the disentangled representations of high-resolution images as privileged information. After training, our method can fully capture identity-invariant representations from downsampled images for expression recognition without the requirement of high-resolution samples. These privacy-protected representations can be safely transmitted through the Internet. Experimental results in different scenarios demonstrate that the proposed method protects privacy without significantly inhibiting facial expression recognition.
Privacy-Preserving Face Recognition for Access Control Systems

Sucan Zhang,Jianfei Ma,Mingxuan Zhang,Jingyu Hua

DOI: https://doi.org/10.1109/mass62177.2024.00053

2024-01-01

Abstract:Face recognition (FR) technology, a highly secure biometric authentication method, has been widely applied in physical access control systems (ACSs). However, the facial information uploaded by users in the system is vulnerable to third parties, which can be utilized to train unauthorized FR models, which could be used for illegal identification of users in unknown contexts, posing significant threats to user privacy. Although many privacy-preserving FR methods have been proposed, they are rarely directly applicable to existing physical ACSs because they require invasive modifications to the core FR algorithms in ACSs. In this paper, we present a non-intrusive facial privacy protection method based on adversarial example technique, which does not require to modify any software or hardware of the target ACS. It first adds subtle perturbations that do not affect visual perception to the facial photos submitted by users, ensuring that the photos could pass the identity verification of human administrators of ACSs but the FR models built on them would mis-recognize real users. Then, it trains physical adversarial example stickers using masks as carriers, which, when worn on the mouth, users could be correctly recognized, thus passing through the ACS successfully. According to experiments conducted on multiple test subjects and various face recognition models, the validity of the proposed method has been demonstrated.
FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders

Kai Wang,Bo Zhao,Xiangyu Peng,Zheng Zhu,Jiankang Deng,Xinchao Wang,Hakan Bilen,Yang You

DOI: https://doi.org/10.48550/arXiv.2205.11090

2022-05-23

Abstract:Face recognition, as one of the most successful applications in artificial intelligence, has been widely used in security, administration, advertising, and healthcare. However, the privacy issues of public face datasets have attracted increasing attention in recent years. Previous works simply mask most areas of faces or synthesize samples using generative models to construct privacy-preserving face datasets, which overlooks the trade-off between privacy protection and data utility. In this paper, we propose a novel framework FaceMAE, where the face privacy and recognition performance are considered simultaneously. Firstly, randomly masked face images are used to train the reconstruction module in FaceMAE. We tailor the instance relation matching (IRM) module to minimize the distribution gap between real faces and FaceMAE reconstructed ones. During the deployment phase, we use trained FaceMAE to reconstruct images from masked faces of unseen identities without extra training. The risk of privacy leakage is measured based on face retrieval between reconstructed and original datasets. Experiments prove that the identities of reconstructed images are difficult to be retrieved. We also perform sufficient privacy-preserving face recognition on several public face datasets (i.e. CASIA-WebFace and WebFace260M). Compared to previous state of the arts, FaceMAE consistently \textbf{reduces at least 50\% error rate} on LFW, CFP-FP and AgeDB.

Computer Vision and Pattern Recognition
Privacy Preserving Face Recognition Utilizing Differential Privacy

M.A.P. Chamikara,P. Bertok,I. Khalil,D. Liu,S. Camtepe

DOI: https://doi.org/10.1016/j.cose.2020.101951

2020-07-04

Abstract:Facial recognition technologies are implemented in many areas, including but not limited to, citizen surveillance, crime control, activity monitoring, and facial expression evaluation. However, processing biometric information is a resource-intensive task that often involves third-party servers, which can be accessed by adversaries with malicious intent. Biometric information delivered to untrusted third-party servers in an uncontrolled manner can be considered a significant privacy leak (i.e. uncontrolled information release) as biometrics can be correlated with sensitive data such as healthcare or financial records. In this paper, we propose a privacy-preserving technique for "controlled information release", where we disguise an original face image and prevent leakage of the biometric features while identifying a person. We introduce a new privacy-preserving face recognition protocol named PEEP (Privacy using EigEnface Perturbation) that utilizes local differential privacy. PEEP applies perturbation to Eigenfaces utilizing differential privacy and stores only the perturbed data in the third-party servers to run a standard Eigenface recognition algorithm. As a result, the trained model will not be vulnerable to privacy attacks such as membership inference and model memorization attacks. Our experiments show that PEEP exhibits a classification accuracy of around 70% - 90% under standard privacy settings.

Cryptography and Security,Databases
Privacy preservation for image data: A GAN‐based method

Zhenfei Chen,Tianqing Zhu,Ping Xiong,Chenguang Wang,Wei Ren

DOI: https://doi.org/10.1002/int.22356

IF: 8.993

2021-01-05

International Journal of Intelligent Systems

Abstract:<p>The importance of protecting personal information, like, a person's address or health history, is well known and commonly discussed. However, images also contain sensitive information that can compromise a person's privacy or be used for nefarious purposes. To date, most methods for preserving privacy with images have relied on obfuscation techniques, such as pixelation, blurring, or masking parts of the image. However, new face‐recognition technologies driven by deep learning are showing cracks in the old techniques. Moreover, faceless recognition is presenting a whole new set of challenges for image privacy. The core of these issues it is how to ensure privacy while still being able to see and use the image. Our solution is a model based on a generative adversarial network that protects identity information while preserving face features of the original image as much as possible. The premise is to generate a fake image of a face that shares all the same attributes as the original image, for example, a brown‐eyed child smiling. With this strategy, the image remains useful, but no person or algorithm could determine the identity of the pictured individual. The framework consists of three parts: a detection module, an image creation module, and an image transformation module. The detection module extracts the attribute labels. The image creation module generates images of faces, and the image transformation module transforms the fake features to match the attributes in the original image. A comprehensive set of experiments shows the effectiveness of the proposed framework.</p>

computer science, artificial intelligence

Convergence of Realistic Projection and Reflection Methods

Privacy-Preserving Face Recognition Using Random Frequency Components

Local Features Meet Stochastic Anonymization: Revolutionizing Privacy-Preserving Face Recognition for Black-Box Models

Reversible Privacy-Preserving Recognition.

Privacy-Preserving Face Recognition Using Trainable Feature Subtraction

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

High Resolution Face Privacy-Enhancing Method Based on Latent Optimization with Identity-Preserving Facial Masking

Privacy-preserving face recognition method based on extensible feature extraction

Make Privacy Renewable! Generating Privacy-Preserving Faces Supporting Cancelable Biometric Recognition

Local Privacy Protection for Sensitive Areas in Multiface Images

Privacy-Preserving Face Recognition in Hybrid Frequency-Color Domain

PRO-Face C: Privacy-Preserving Recognition of Obfuscated Face via Feature Compensation

Transferable Adversarial Facial Images for Privacy Protection

Privacy-preserving Adversarial Facial Features

People Taking Photos That Faces Never Share: Privacy Protection and Fairness Enhancement from Camera to User

Research on the Privacy Security of Face Recognition Technology

Privacy-Protected Facial Expression Recognition Augmented by High-Resolution Facial Images.

Privacy-Preserving Face Recognition for Access Control Systems

FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders

Privacy Preserving Face Recognition Utilizing Differential Privacy

Privacy preservation for image data: A GAN‐based method