Abstract:In collaborative deep learning, current learning frameworks follow either a centralized architecture or a distributed architecture. Whilst centralized architecture deploys a central server to train a global model over the massive amount of joint data from all parties, distributed architecture aggregates parameter updates from participating parties' local model training, via a parameter server. These two server-based architectures present security and robustness vulnerabilities such as single-point-of-failure, single-point-of-breach, privacy leakage, and lack of fairness. To address these problems, we design, implement, and evaluate a purely decentralized privacy-preserving deep learning framework, called DPPDL. DPPDL makes the first investigation on the research problem of fairness in collaborative deep learning, and simultaneously provides fairness and privacy by proposing two novel algorithms: initial benchmarking and privacy-preserving collaborative deep learning. During initial benchmarking, each party trains a local Differentially Private Generative Adversarial Network (DPGAN) and publishes the generated privacy-preserving artificial samples for other parties to label, based on the quality of which to initialize local credibility list for other parties. The local credibility list reflects how much one party contributes to another party, and it is used and updated during collaborative learning to ensure fairness. To protect gradients transaction during privacy-preserving collaborative deep learning, we further put forward a three-layer onion-style encryption scheme. We experimentally demonstrate, on benchmark image datasets, that accuracy, privacy and fairness in collaborative deep learning can be effectively addressed at the same time by our proposed DPPDL framework. Moreover, DPPDL provides a viable solution to detect and isolate the cheating party in the system.

Proof of Privacy-Preserving Machine Learning: A Blockchain Consensus Mechanism with Secure Deep Learning Process

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Decentralized Iot Data Sharing: A Blockchain-Based Federated Learning Approach with Joint Optimizations for Efficiency and Privacy

Proof of Learning (PoLe): Empowering Machine Learning with Consensus Building on Blockchains

PPBFL: A Privacy Protected Blockchain-based Federated Learning Model

Towards Fair and Decentralized Privacy-Preserving Deep Learning with Blockchain.

Proof of Learning: Towards a Practical Blockchain Consensus Mechanism Using Directed Guiding Gradients (student Abstract)

Training Encrypted Models with Privacy-preserved Data on Blockchain

Efficient Privacy-Preserving Machine Learning for Blockchain Network

Proof of Deep Learning: Approaches, Challenges, and Future Directions

SPDL: Blockchain-secured and Privacy-preserving Decentralized Learning

Proof of Federated Learning: A Novel Energy-recycling Consensus Algorithm

A Platform-Free Proof of Federated Learning Consensus Mechanism for Sustainable Blockchains

Proof-of-Contribution-Based Design for Collaborative Machine Learning on Blockchain

Secure and Trusted Collaborative Learning Based on Blockchain for Artificial Intelligence of Things

A verifiable and privacy-preserving blockchain-based federated learning approach

Democratic learning: hardware/software co-design for lightweight blockchain-secured on-device machine learning

Blockchain-Based Federated Learning With Enhanced Privacy and Security Using Homomorphic Encryption and Reputation

FedChain: An Efficient and Secure Consensus Protocol based on Proof of Useful Federated Learning for Blockchain

Secure Collaborative Learning in Mining Pool Via Robust and Efficient Verification