Abstract:With strict protections and regulations of data privacy and security, conventional machine learning based on centralized datasets is confronted with significant challenges, making artificial intelligence (AI) impractical in many mission-critical and data-sensitive scenarios, such as finance, government, and health. In the meantime, tremendous datasets are scattered in isolated silos in various industries, organizations, different units of an organization, or different branches of an international organization. These valuable data resources are well underused. To advance AI theories and applications, we propose a comprehensive framework (called Knowledge Federation - KF) to address these challenges by enabling AI while preserving data privacy and ownership. Beyond the concepts of federated learning and secure multi-party computation, KF consists of four levels of federation: (1) information level, low-level statistics and computation of data, meeting the requirements of simple queries, searching and simplistic operators; (2) model level, supporting training, learning, and inference; (3) cognition level, enabling abstract feature representation at various levels of abstractions and contexts; (4) knowledge level, fusing knowledge discovery, representation, and reasoning. We further clarify the relationship and differentiation between knowledge federation and other related research areas. We have developed a reference implementation of KF, called iBond Platform, to offer a production-quality KF platform to enable industrial applications in finance, insurance et al. The iBond platform will also help establish the KF community and a comprehensive ecosystem and usher in a novel paradigm shift towards secure, privacy-preserving and responsible AI. As far as we know, knowledge federation is the first hierarchical and unified framework for secure multi-party computing and learning.

Federated Ecology: from Federated Data to Federated Intelligence

Research on the Application of Government Big Data Platform Based on Federated Learning

Research and Application of Cross-Domain Data Authorization and Operation

Decentralized Iot Data Sharing: A Blockchain-Based Federated Learning Approach with Joint Optimizations for Efficiency and Privacy

Data Privacy: from Transparency to Fairness

Knowledge Federation: A Unified and Hierarchical Privacy-Preserving AI Framework

Federated Machine Learning: Concept and Applications

FDC: A Secure Federated Deep Learning Mechanism for Data Collaborations in the Internet of Things

Empowering Data Mesh with Federated Learning

Federated Extra-Trees with Privacy Preserving

Swarm Learning for Secure and Effective Industrial Federated Big Data Analytics

From distributed machine learning to federated learning: In the view of data privacy and security

A Study of Federated Learning with Internet of Things for Data Privacy and Security using Privacy Preserving Techniques

Federated Learning Architecture: Design, Implementation, and Challenges in Distributed AI Systems

Federated Learning Intellectual Capital Platform

Federated Analytics-Empowered Frequent Pattern Mining for Decentralized Web 3.0 Applications

A Survey on Federated Analytics: Taxonomy, Enabling Techniques, Applications and Open Issues

Integration of Edge Computing and Blockchain for Provision of Data Fusion and Secure Big Data Analysis for Internet of Things

Federated Analytics in Practice: Engineering for Privacy, Scalability and Practicality

Fed-EINI: An Efficient and Interpretable Inference Framework for Decision Tree Ensembles in Federated Learning

Survey: federated learning data security and privacy-preserving in edge-Internet of Things