Abstract:This article provides the motivation and overview of the Collective Knowledge Framework (CK or cKnowledge). The CK concept is to decompose research projects into reusable components that encapsulate research artifacts and provide unified application programming interfaces (APIs), command-line interfaces (CLIs), meta descriptions and common automation actions for related artifacts. The CK framework is used to organize and manage research projects as a database of such components. Inspired by the USB 'plug and play' approach for hardware, CK also helps to assemble portable workflows that can automatically plug in compatible components from different users and vendors (models, datasets, frameworks, compilers, tools). Such workflows can build and run algorithms on different platforms and environments in a unified way using the customizable CK program pipeline with software detection plugins and the automatic installation of missing packages. This article presents a number of industrial projects in which the modular CK approach was successfully validated in order to automate benchmarking, auto-tuning and co-design of efficient software and hardware for machine learning and artificial intelligence in terms of speed, accuracy, energy, size and various costs. The CK framework also helped to automate the artifact evaluation process at several computer science conferences as well as to make it easier to reproduce, compare and reuse research techniques from published papers, deploy them in production, and automatically adapt them to continuously changing datasets, models and systems. The long-term goal is to accelerate innovation by connecting researchers and practitioners to share and reuse all their knowledge, best practices, artifacts, workflows and experimental results in a common, portable and reproducible format at https://cKnowledge.io/. This article is part of the theme issue 'Reliability and reproducibility in computational science: implementing verification, validation and uncertainty quantification in silico'.

A Theory of Knowledge Revision: the Development of the KReC Framework

Re3: A Holistic Framework and Dataset for Modeling Collaborative Document Revision

The knowledge-learning-instruction framework: bridging the science-practice chasm to enhance robust student learning

Human-Aware Belief Revision: A Cognitively Inspired Framework for Explanation-Guided Revision of Human Models

KICE: A Knowledge Consolidation and Expansion Framework for Relation Extraction.

Knowledge, Knowledge Work and Organizations: An Overview and Interpretation

The Recursive Theory of Knowledge Augmentation: Integrating human intuition and knowledge in Artificial Intelligence to augment organizational knowledge

A Knowledge Recombination Perspective of Innovation: Review and New Research Directions

Knowledge revision in systems based on an informed tree search strategy : application to cartographic generalisation

Cognitive Bias and Belief Revision

Understanding Revision Behavior in Adaptive Writing Support Systems for Education

Socio-cognitive dynamics of knowledge building in the work of 9- and 10-year-olds

Rethinking College Student Development Theory Using Critical Frameworks

Dynamic source credibility and its impacts on knowledge revision

Reopening Inquiry into Cognitive Processes in Writing-To-Learn

Optimal Belief Revision

Epistemological perspectives on conceptual change: Implications for educational practice

Collective knowledge: organizing research projects as a database of reusable components and portable workflows with common interfaces

Reframing curriculum for religious education

Understanding Iterative Revision from Human-Written Text

The AIR and Apt-AIR Frameworks of Epistemic Performance and Growth: Reflections on Educational Theory Development