Abstract:With strict protections and regulations of data privacy and security, conventional machine learning based on centralized datasets is confronted with significant challenges, making artificial intelligence (AI) impractical in many mission-critical and data-sensitive scenarios, such as finance, government, and health. In the meantime, tremendous datasets are scattered in isolated silos in various industries, organizations, different units of an organization, or different branches of an international organization. These valuable data resources are well underused. To advance AI theories and applications, we propose a comprehensive framework (called Knowledge Federation - KF) to address these challenges by enabling AI while preserving data privacy and ownership. Beyond the concepts of federated learning and secure multi-party computation, KF consists of four levels of federation: (1) information level, low-level statistics and computation of data, meeting the requirements of simple queries, searching and simplistic operators; (2) model level, supporting training, learning, and inference; (3) cognition level, enabling abstract feature representation at various levels of abstractions and contexts; (4) knowledge level, fusing knowledge discovery, representation, and reasoning. We further clarify the relationship and differentiation between knowledge federation and other related research areas. We have developed a reference implementation of KF, called iBond Platform, to offer a production-quality KF platform to enable industrial applications in finance, insurance et al. The iBond platform will also help establish the KF community and a comprehensive ecosystem and usher in a novel paradigm shift towards secure, privacy-preserving and responsible AI. As far as we know, knowledge federation is the first hierarchical and unified framework for secure multi-party computing and learning.

Block-chain Based Federated Learning for Knowledge Capital

Decentralized Iot Data Sharing: A Blockchain-Based Federated Learning Approach with Joint Optimizations for Efficiency and Privacy

Federated Learning Intellectual Capital Platform

Training Encrypted Models with Privacy-preserved Data on Blockchain

A Blockchain System for Clustered Federated Learning with Peer-to-Peer Knowledge Transfer.

Blockchain-Based platform for Distribution AI

Knowledge Federation: A Unified and Hierarchical Privacy-Preserving AI Framework

BlockDL - Privacy-Preserving and Crowd-Sourced Deep Learning Through Blockchain.

FedBC: Blockchain-based Decentralized Federated Learning

Enhancing trust and privacy in distributed networks: a comprehensive survey on blockchain-based federated learning

BlockDFL: A Blockchain-based Fully Decentralized Peer-to-Peer Federated Learning Framework

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

A Systematic Survey of Blockchained Federated Learning

Towards blockchain-enabled decentralized and secure federated learning

Time-Efficient Blockchain-Based Federated Learning

Blockchain-Based Federated Learning: Incentivizing Data Sharing and Penalizing Dishonest Behavior

A Novel Framework for Distributed and Collaborative Federated Learning Based on Blockchain and Smart Contracts

Secure and decentralized federated learning framework with non-IID data based on blockchain

Public and Private Blockchain Infusion: A Novel Approach to Federated Learning

A Research and Analysis of Blockchain Federated Learning