Abstract:Federated learning (FL) aims to protect data privacy by cooperatively learning a model without sharing private data among users. For Federated Learning of Deep Neural Network with billions of model parameters, existing privacy-preserving solutions are unsatisfactory. Homomorphic encryption (HE) based methods provide secure privacy protections but suffer from extremely high computational and communication overheads rendering it almost useless in practice . Deep learning with Differential Privacy (DP) was implemented as a practical learning algorithm at a manageable cost in complexity. However, DP is vulnerable to aggressive Bayesian restoration attacks as disclosed in the literature and demonstrated in experimental results of this work. To address the aforementioned perplexity, we propose a novel Bayesian Privacy (BP) framework which enables Bayesian restoration attacks to be formulated as the probability of reconstructing private data from observed public information. Specifically, the proposed BP framework accurately quantifies privacy loss by Kullback-Leibler (KL) Divergence between the prior distribution about the privacy data and the posterior distribution of restoration private data conditioning on exposed information}. To our best knowledge, this Bayesian Privacy analysis is the first to provides theoretical justification of secure privacy-preserving capabilities against Bayesian restoration attacks. As a concrete use case, we demonstrate that a novel federated deep learning method using private passport layers is able to simultaneously achieve high model performance, privacy-preserving capability and low computational complexity. Theoretical analysis is in accordance with empirical measurements of information leakage extensively experimented with a variety of DNN networks on image classification MNIST, CIFAR10, and CIFAR100 datasets.

Towards privacy palmprint recognition via federated hash learning

Privacy Preserving Palmprint Recognition Via Federated Metric Learning

Towards Efficient Unconstrained Palmprint Recognition via Deep Distillation Hashing

Deep Distillation Hashing for Unconstrained Palmprint Recognition

Efficient Deep Palmprint Recognition Via Distilled Hashing Coding

Few-shot Palmprint Recognition Based on Similarity Metric Hashing Network.

Effective Deep Ensemble Hashing for Open-Set Palmprint Recognition.

A Deep Biometric Hash Learning Framework for Three Advanced Hand‐based Biometrics

Towards Cross-Dataset Palmprint Recognition Via Joint Pixel and Feature Alignment

Learning with Partners to Improve the Multi-Source Cross-Dataset Palmprint Recognition

A Joint Pixel and Feature Alignment Framework for Cross-dataset Palmprint Recognition

Federated Deep Learning with Bayesian Privacy

Homomorphic Encryption-Based Privacy Protection for Palmprint Recognition

DDP-FedFV: A Dual-Decoupling Personalized Federated Learning Framework for Finger Vein Recognition

High Accuracy Fingerprint Localization: A Robust Federated Learning Method

Multi-Target Cross-Dataset Palmprint Recognition Via Distilling from Multi-Teacher.

Siamese-Hashing Network for Few-Shot Palmprint Recognition

Local differentially private federated learning with homomorphic encryption

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing

A Multimodal Biometric Recognition Method Based on Federated Learning

Privacy-Preserving and Robust Federated Deep Metric Learning