Rucio - Scientific data management

Martin Barisits,Thomas Beermann,Frank Berghaus,Brian Bockelman,Joaquin Bogado,David Cameron,Dimitrios Christidis,Diego Ciangottini,Gancho Dimitrov,Markus Elsing,Vincent Garonne,Alessandro di Girolamo,Luc Goossens,Wen Guan,Jaroslav Guenther,Tomas Javurek,Dietmar Kuhn,Mario Lassnig,Fernando Lopez,Nicolo Magini,Angelos Molfetas,Armin Nairz,Farid Ould-Saada,Stefan Prenner,Cedric Serfon,Graeme Stewart,Eric Vaandering,Petya Vasileva,Ralph Vigne,Tobias Wegner
DOI: https://doi.org/10.1007/s41781-019-0026-3
2019-06-06
Abstract:Rucio is an open-source software framework that provides scientific collaborations with the functionality to organize, manage, and access their data at scale. The data can be distributed across heterogeneous data centers at widely distributed locations. Rucio was originally developed to meet the requirements of the high-energy physics experiment ATLAS, and now is continuously extended to support the LHC experiments and other diverse scientific communities. In this article, we detail the fundamental concepts of Rucio, describe the architecture along with implementation details, and give operational experience from production usage.
Distributed, Parallel, and Cluster Computing
What problem does this paper attempt to address?