Abstract:In collaborative deep learning, current learning frameworks follow either a centralized architecture or a distributed architecture. Whilst centralized architecture deploys a central server to train a global model over the massive amount of joint data from all parties, distributed architecture aggregates parameter updates from participating parties' local model training, via a parameter server. These two server-based architectures present security and robustness vulnerabilities such as single-point-of-failure, single-point-of-breach, privacy leakage, and lack of fairness. To address these problems, we design, implement, and evaluate a purely decentralized privacy-preserving deep learning framework, called DPPDL. DPPDL makes the first investigation on the research problem of fairness in collaborative deep learning, and simultaneously provides fairness and privacy by proposing two novel algorithms: initial benchmarking and privacy-preserving collaborative deep learning. During initial benchmarking, each party trains a local Differentially Private Generative Adversarial Network (DPGAN) and publishes the generated privacy-preserving artificial samples for other parties to label, based on the quality of which to initialize local credibility list for other parties. The local credibility list reflects how much one party contributes to another party, and it is used and updated during collaborative learning to ensure fairness. To protect gradients transaction during privacy-preserving collaborative deep learning, we further put forward a three-layer onion-style encryption scheme. We experimentally demonstrate, on benchmark image datasets, that accuracy, privacy and fairness in collaborative deep learning can be effectively addressed at the same time by our proposed DPPDL framework. Moreover, DPPDL provides a viable solution to detect and isolate the cheating party in the system.

PD2S: A Privacy-Preserving Differentiated Data Sharing Scheme based on Blockchain and Federated Learning

Decentralized Iot Data Sharing: A Blockchain-Based Federated Learning Approach with Joint Optimizations for Efficiency and Privacy

DS2PM: A Data-Sharing Privacy Protection Model Based on Blockchain and Federated Learning

DS2PM:A Data Sharing Privacy Protection Model Based on Blockchain and Federated Learning

Privacy-Preserving Blockchain Based Federated Learning with Differential Data Sharing

BDSP: A Fair Blockchain-enabled Framework for Privacy-Enhanced Enterprise Data Sharing

Scalable and Privacy-Preserving Data Sharing Based on Blockchain

Privacy-preserving Decentralized Federated Deep Learning.

Hybrid Aggregation for Federated Learning under Blockchain Framework

Blockchain-Based Efficiently Privacy-Preserving Federated Learning Framework Using Shamir Secret Sharing

Towards Fair and Decentralized Privacy-Preserving Deep Learning with Blockchain.

SPDL: A Blockchain-Enabled Secure and Privacy-Preserving Decentralized Learning System.

Blockchain-Based Privacy-Preserving Medical Data Sharing Scheme Using Federated Learning

Fast-CFLB: A Privacy-Preserving Data Sharing System for Internet of Vehicles Using Ternary Federated Learning and Blockchain

SPDL: Blockchain-secured and Privacy-preserving Decentralized Learning

A blockchain-based privacy-preserving asynchronous federated learning

Privacy-Preserving Asynchronous Federated Learning Framework in Distributed IoT.

Blockchain-Enabled Hierarchical Federated Learning in Resource-Constrained Power Systems

Privacy-preserving Aggregation Scheme for Blockchained Federated Learning in IoT.

Mutual-Supervised Federated Learning and Blockchain-Based IoT Data Sharing

Privacy-Preservation Robust Federated Learning with Blockchain-based Hierarchical Framework.