Abstract:This article provides the motivation and overview of the Collective Knowledge Framework (CK or cKnowledge). The CK concept is to decompose research projects into reusable components that encapsulate research artifacts and provide unified application programming interfaces (APIs), command-line interfaces (CLIs), meta descriptions and common automation actions for related artifacts. The CK framework is used to organize and manage research projects as a database of such components. Inspired by the USB 'plug and play' approach for hardware, CK also helps to assemble portable workflows that can automatically plug in compatible components from different users and vendors (models, datasets, frameworks, compilers, tools). Such workflows can build and run algorithms on different platforms and environments in a unified way using the customizable CK program pipeline with software detection plugins and the automatic installation of missing packages. This article presents a number of industrial projects in which the modular CK approach was successfully validated in order to automate benchmarking, auto-tuning and co-design of efficient software and hardware for machine learning and artificial intelligence in terms of speed, accuracy, energy, size and various costs. The CK framework also helped to automate the artifact evaluation process at several computer science conferences as well as to make it easier to reproduce, compare and reuse research techniques from published papers, deploy them in production, and automatically adapt them to continuously changing datasets, models and systems. The long-term goal is to accelerate innovation by connecting researchers and practitioners to share and reuse all their knowledge, best practices, artifacts, workflows and experimental results in a common, portable and reproducible format at https://cKnowledge.io/. This article is part of the theme issue 'Reliability and reproducibility in computational science: implementing verification, validation and uncertainty quantification in silico'.

Progress in the development of national knowledge infrastructure

A Uniform Human Knowledge Interface to the Multi-Domain Knowledge Bases in the National Knowledge Infrastructure

Knowledge Engineering with Big Data (bigke): A 54-Month, 45-Million RMB, 15-Institution National Grand Project.

China National Knowledge Infrastructure (CNKI) as a Resource for Nineteenth-Century Music Studies

An Information Feature Extraction and Rapid Updating Scheme for Knowledge Centric Networking

OpenKG Chain: A Blockchain Infrastructure for Open Knowledge Graphs

KCN: Knowledge Centric Networking

Knowledge Network System (KNS) by Evolutionary Collective Intelligence (ECI): Model, Algorithm and Applications

A Study on Big Knowledge and Its Engineering Issues

Library As Knowledge Ecosystem

Knowledge Graph for Multi-source Data Fusion Topics Research

1+1>2: Programming Know-What and Know-How Knowledge Fusion, Semantic Enrichment and Coherent Application

Knowledge Integration and Sharing for Complex Product Development

Collective knowledge: organizing research projects as a database of reusable components and portable workflows with common interfaces

Casia-Kb: A Multi-Source Chinese Semantic Knowledge Base Built From Structured And Unstructured Web Data

Collective Knowledge: organizing research projects as a database of reusable components and portable workflows with common APIs

On knowledge based intelligence

TechKG: A Large-Scale Chinese Technology-Oriented Knowledge Graph

The Theoretical Basis and Basic Principles of Knowledge Network Construction in Digital Library

KB-Grid: Enabling Knowledge Sharing on the Semantic Web

Dimensions of knowledge sharing and reuse