Abstract:Massive amounts of data drive the performance of deep learning models, but in practice, data resources are often highly dispersed and bound by data privacy and security concerns, making it difficult for multiple data sources to share their local data directly. Data resources are difficult to aggregate effectively, resulting in a lack of support for model training. How to collaborate between data sources in order to aggregate the value of data resources is therefore an important research question. However, existing distributed-collaborative-learning architectures still face serious challenges in collaborating between nodes that lack mutual trust, with security and trust issues seriously affecting the confidence and willingness of data sources to participate in collaboration. Blockchain technology provides trusted distributed storage and computing, and combining it with collaboration between data sources to build trusted distributed-collaborative-learning architectures is an extremely valuable research direction for application. We propose a trusted distributed-collaborative-learning mechanism based on blockchain smart contracts. Firstly, the mechanism uses blockchain smart contracts to define and encapsulate collaborative behaviours, relationships and norms between distributed collaborative nodes. Secondly, we propose a model-fusion method based on feature fusion, which replaces the direct sharing of local data resources with distributed-model collaborative training and organises distributed data resources for distributed collaboration to improve model performance. Finally, in order to verify the trustworthiness and usability of the proposed mechanism, on the one hand, we implement formal modelling and verification of the smart contract by using Coloured Petri Net and prove that the mechanism satisfies the expected trustworthiness properties by verifying the formal model of the smart contract associated with the mechanism. On the other hand, the model-fusion method based on feature fusion is evaluated in different datasets and collaboration scenarios, while a typical collaborative-learning case is implemented for a comprehensive analysis and validation of the mechanism. The experimental results show that the proposed mechanism can provide a trusted and fair collaboration infrastructure for distributed-collaboration nodes that lack mutual trust and organise decentralised data resources for collaborative model training to develop effective global models.

SecCL: Securing Collaborative Learning Systems Via Trusted Bulletin Boards.

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

A Three-layer Security Assurance Model for a Decentralized Federated Learning System

Decentralized Iot Data Sharing: A Blockchain-Based Federated Learning Approach with Joint Optimizations for Efficiency and Privacy

Secure and Trusted Collaborative Learning Based on Blockchain for Artificial Intelligence of Things

Robust and Privacy-Preserving Collaborative Learning: A Comprehensive Survey

TDLearning: Trusted Distributed Collaborative Learning Based on Blockchain Smart Contracts

Training Encrypted Models with Privacy-preserved Data on Blockchain

PPCL: Privacy-preserving collaborative learning for mitigating indirect information leakage

Blockchain-Based Trusted Federated Learning with Pre-Trained Models for COVID-19 Detection

Reaching Data Confidentiality and Model Accountability on the CalTrain

Robust and privacy-preserving collaborative training: a comprehensive survey

PrivColl: Practical Privacy-Preserving Collaborative Machine Learning

A Blockchain-Based Fairness Guarantee Approach for Privacy-Preserving Collaborative Training in Computing Force Network

SPDL: A Blockchain-Enabled Secure and Privacy-Preserving Decentralized Learning System.

Towards Confidential Chatbot Conversations: A Decentralised Federated Learning Framework

Secure Architectures Implementing Trusted Coalitions for Blockchained Distributed Learning (TCLearn)

SPDL: Blockchain-secured and Privacy-preserving Decentralized Learning

Learning in Your “Pocket”: Secure Collaborative Deep Learning with Membership Privacy

Decentralized Collaborative Learning Framework with External Privacy Leakage Analysis

PrSeFL: Achieving Practical Privacy and Robustness in Blockchain-Based Federated Learning