Abstract:Distributed learning is proposed as a promising technique to reduce heavy data transmissions in centralized machine learning. By allowing the participants training the model locally, raw data is unnecessarily uploaded to the centralized cloud server, reducing the risks of privacy leakage as well. However, the existing studies have shown that an adversary is able to derive the raw data by analyzing the obtained machine learning models. To tackle this challenge, the state-of-the-art solutions mainly depend on differential privacy and encryption techniques (e.g., homomorphic encryption). Whereas, differential privacy degrades data utility and leads to inaccurate learning, while encryption based approaches are not effective to all machine learning algorithms due to the limited operations and excessive computation cost. In this work, we propose a novel scheme to resolve the privacy issues from the anonymous authentication approach. Different from the two types of existing solutions, this approach is generalized to all machine learning algorithms without reducing data utility, while guaranteeing privacy preservation. In addition, it can be integrated with detection schemes against data poisoning attacks and free-rider attacks, being more practical for distributed learning. To this end, we first design a pairing-based certificateless signature scheme. Based on the signature scheme, we further propose an anonymous and efficient authentication protocol which supports dynamic batch verification. The proposed protocol guarantees the desired security properties while being computationally efficient. Formal security proof and analysis have been provided to demonstrate the achieved security properties, including confidentiality, anonymity, mutual authentication, unlinkability, unforgeability, forward security, backward security, and non-repudiation. In addition, the performance analysis reveals that our proposed protocol significantly reduces the time consumption in batch verification, achieving high computational efficiency.

Anonymous and Efficient Authentication Scheme for Privacy-Preserving Distributed Learning

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

A secure distributed machine learning protocol against static semi-honest adversaries

An efficient anonymous authentication scheme based on a signature with deterable function for mobile healthcare crowd sensing

Privacy-Preserving Distributed Deep Learning Via Homomorphic Re-Encryption

An Efficient Anonymous Authentication Scheme Based on Double Authentication Preventing Signature for Mobile Healthcare Crowd Sensing.

Blockchain-Based Decentralized and Lightweight Anonymous Authentication for Federated Learning

Distributed Machine Learning Oriented Data Integrity Verification Scheme in Cloud Computing Environment

Locally Differentially Private Distributed Online Learning with Guaranteed Optimality

Guaranteed Distributed Machine Learning: Privacy-preserving Empirical Risk Minimization

Insuring against the perils in distributed learning: privacy-preserving empirical risk minimization

Privacy-preserving Decentralized Deep Learning with Multiparty Homomorphic Encryption

Efficient Privacy-Preserving Machine Learning in Hierarchical Distributed System

A Privacy-Preserving and Verifiable Federated Learning Scheme

Differential Privacy-preserving Distributed Machine Learning

Distributed Intelligent Model for Privacy and Secrecy in Preschool Education

Distributed and Personalised Social Network Privacy Protection

Dynamic Secure Multi Broad Network for Privacy Preserving of Streaming Data

A general differentially private learning framework for decentralized data

Privacy-Preserving Distributed Optimization and Learning

PD-ML-Lite: Private Distributed Machine Learning from Lighweight Cryptography