Abstract:Big bibliographic datasets hold promise for revolutionizing the scientific enterprise when combined with state-of-the-science computational capabilities. Yet, hosting proprietary and open big bibliographic datasets poses significant difficulties for libraries, both large and small. Libraries face significant barriers to hosting such assets, including cost and expertise, which has limited their ability to provide stewardship for big datasets, and thus has hampered researchers' access to them. What is needed is a solution to address the libraries' and researchers' joint needs. This article outlines the theoretical framework that underpins the Collaborative Archive and Data Research Environment project. We recommend a shared cloud-based infrastructure to address this need built on five pillars: 1) Community-a community of libraries and industry partners who support and maintain the platform and a community of researchers who use it; 2) Access-the sharing platform should be accessible and affordable to both proprietary data customers and the general public; 3) Data-Centric-the platform is optimized for efficient and high-quality bibliographic data services, satisfying diverse data needs; 4) Reproducibility-the platform should be designed to foster and encourage reproducible research; 5) Empowerment-the platform should empower researchers to perform big data analytics on the hosted datasets. In this article, we describe the many facets of the problem faced by American academic libraries and researchers wanting to work with big datasets. We propose a practical solution based on the five pillars: The Collaborative Archive and Data Research Environment. Finally, we address potential barriers to implementing this solution and strategies for overcoming them.

NCore: Architecture and Implementation of a Flexible, Collaborative Digital Library

Representing Contextualized Information in the NSDL

An Ontology-Based Domain Modeling Framework for Knowledge Service in Digital Library

Components of an NSDL Architecture: Technical Scope and Functional Model

A Scalable, Adaptive, Self-management and Fault-Tolerant Architecture for Digital Library

CORE: A Global Aggregation Service for Open Access Papers

CoreDB

Collaborative digital library of historical resources: Evaluation of first users

Telling Great Stories: An NSDL Content and Communications System for Aggregation, Display, and Distribution of News and Features

Digital Libraries, Conceptual Knowledge Systems, and the Nebula Interface

The Theoretical Basis and Basic Principles of Knowledge Network Construction in Digital Library

Flexible and Extensible Digital Object and Repository Architecture (FEDORA)

CDAL: A Scalable Scheme for Digital Resource Reorganization

DCRP: Digital Collaborative R&D Platform for TNList

NFDIcore 2.0: A BFO-Compliant Ontology for Multi-Domain Research Infrastructures

The PROBADO Project - Approach and Lessons Learned in Building a Digital Library System for Heterogeneous Non-textual Documents

The Model of CALIS' Cloud Service Platform for Distributed Digital Libraries

A role of antiquantum bits for superdense coding and quantum computing

The NPC Framework for Building Information Dissemination Networks

CADRE: A Collaborative, Cloud-Based Solution for Big Bibliographic Data Research in Academic Libraries

The Mellon Fedora Project: Digital Library Architecture Meets XML and Web Services