Cargando…
Experience with Rucio in the wider HEP community
Managing the data of scientific projects is an increasingly complicated challenge, which was usually met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years...
Autores principales: | , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2021
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202125102030 http://cds.cern.ch/record/2772506 |
_version_ | 1780971451548958720 |
---|---|
author | Barisits, Martin Beermann, Thomas Cameron, David Clark, James Alexander Di Maria, Riccardo Fronzé, Gabriele Gaetano Johnson, Ian Lassnig, Mario Serfon, Cédric Vaandering, Eric W |
author_facet | Barisits, Martin Beermann, Thomas Cameron, David Clark, James Alexander Di Maria, Riccardo Fronzé, Gabriele Gaetano Johnson, Ian Lassnig, Mario Serfon, Cédric Vaandering, Eric W |
author_sort | Barisits, Martin |
collection | CERN |
description | Managing the data of scientific projects is an increasingly complicated challenge, which was usually met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years the scientific data management system Rucio has evolved into a successful open-source project, now being used by many scientific communities and organisations. Rucio is incorporating the contributions and expertise of many scientific projects, offering common features useful to a diverse research community. This article describes the recent experiences in operating Rucio as well as contributions to the project by ATLAS, Belle II, CMS, LDMX, Folding@Home, and STFC. |
id | cern-2772506 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2021 |
record_format | invenio |
spelling | cern-27725062022-08-23T21:03:48Zdoi:10.1051/epjconf/202125102030http://cds.cern.ch/record/2772506engBarisits, MartinBeermann, ThomasCameron, DavidClark, James AlexanderDi Maria, RiccardoFronzé, Gabriele GaetanoJohnson, IanLassnig, MarioSerfon, CédricVaandering, Eric WExperience with Rucio in the wider HEP communityParticle Physics - ExperimentComputing and ComputersManaging the data of scientific projects is an increasingly complicated challenge, which was usually met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years the scientific data management system Rucio has evolved into a successful open-source project, now being used by many scientific communities and organisations. Rucio is incorporating the contributions and expertise of many scientific projects, offering common features useful to a diverse research community. This article describes the recent experiences in operating Rucio as well as contributions to the project by ATLAS, Belle II, CMS, LDMX, Folding@Home, and STFC.Managing the data of scientific projects is an increasingly complicated challenge, which was historically met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years, the scientific data management system Rucio has evolved into a successful open-source project that is now being used by many scientific communities and organisations. Rucio is incorporating the contributions and expertise of many scientific projects and is offering common features useful to a diverse research community. This article describes the recent experiences in operating Rucio, as well as contributions to the project, by ATLAS, Belle II, CMS, ESCAPE, IGWN, LDMX, Folding@Home, and the UK’s Science and Technology Facilities Council (STFC).ATL-SOFT-PROC-2021-009FERMILAB-CONF-21-753-SCDoai:cds.cern.ch:27725062021-06-11 |
spellingShingle | Particle Physics - Experiment Computing and Computers Barisits, Martin Beermann, Thomas Cameron, David Clark, James Alexander Di Maria, Riccardo Fronzé, Gabriele Gaetano Johnson, Ian Lassnig, Mario Serfon, Cédric Vaandering, Eric W Experience with Rucio in the wider HEP community |
title | Experience with Rucio in the wider HEP community |
title_full | Experience with Rucio in the wider HEP community |
title_fullStr | Experience with Rucio in the wider HEP community |
title_full_unstemmed | Experience with Rucio in the wider HEP community |
title_short | Experience with Rucio in the wider HEP community |
title_sort | experience with rucio in the wider hep community |
topic | Particle Physics - Experiment Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202125102030 http://cds.cern.ch/record/2772506 |
work_keys_str_mv | AT barisitsmartin experiencewithruciointhewiderhepcommunity AT beermannthomas experiencewithruciointhewiderhepcommunity AT camerondavid experiencewithruciointhewiderhepcommunity AT clarkjamesalexander experiencewithruciointhewiderhepcommunity AT dimariariccardo experiencewithruciointhewiderhepcommunity AT fronzegabrielegaetano experiencewithruciointhewiderhepcommunity AT johnsonian experiencewithruciointhewiderhepcommunity AT lassnigmario experiencewithruciointhewiderhepcommunity AT serfoncedric experiencewithruciointhewiderhepcommunity AT vaanderingericw experiencewithruciointhewiderhepcommunity |