Cargando…

Experience with Rucio in the wider HEP community

Managing the data of scientific projects is an increasingly complicated challenge, which was usually met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years...

Descripción completa

Detalles Bibliográficos
Autores principales: Barisits, Martin, Beermann, Thomas, Cameron, David, Clark, James Alexander, Di Maria, Riccardo, Fronzé, Gabriele Gaetano, Johnson, Ian, Lassnig, Mario, Serfon, Cédric, Vaandering, Eric W
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202125102030
http://cds.cern.ch/record/2772506
_version_ 1780971451548958720
author Barisits, Martin
Beermann, Thomas
Cameron, David
Clark, James Alexander
Di Maria, Riccardo
Fronzé, Gabriele Gaetano
Johnson, Ian
Lassnig, Mario
Serfon, Cédric
Vaandering, Eric W
author_facet Barisits, Martin
Beermann, Thomas
Cameron, David
Clark, James Alexander
Di Maria, Riccardo
Fronzé, Gabriele Gaetano
Johnson, Ian
Lassnig, Mario
Serfon, Cédric
Vaandering, Eric W
author_sort Barisits, Martin
collection CERN
description Managing the data of scientific projects is an increasingly complicated challenge, which was usually met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years the scientific data management system Rucio has evolved into a successful open-source project, now being used by many scientific communities and organisations. Rucio is incorporating the contributions and expertise of many scientific projects, offering common features useful to a diverse research community. This article describes the recent experiences in operating Rucio as well as contributions to the project by ATLAS, Belle II, CMS, LDMX, Folding@Home, and STFC.
id cern-2772506
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27725062022-08-23T21:03:48Zdoi:10.1051/epjconf/202125102030http://cds.cern.ch/record/2772506engBarisits, MartinBeermann, ThomasCameron, DavidClark, James AlexanderDi Maria, RiccardoFronzé, Gabriele GaetanoJohnson, IanLassnig, MarioSerfon, CédricVaandering, Eric WExperience with Rucio in the wider HEP communityParticle Physics - ExperimentComputing and ComputersManaging the data of scientific projects is an increasingly complicated challenge, which was usually met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years the scientific data management system Rucio has evolved into a successful open-source project, now being used by many scientific communities and organisations. Rucio is incorporating the contributions and expertise of many scientific projects, offering common features useful to a diverse research community. This article describes the recent experiences in operating Rucio as well as contributions to the project by ATLAS, Belle II, CMS, LDMX, Folding@Home, and STFC.Managing the data of scientific projects is an increasingly complicated challenge, which was historically met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years, the scientific data management system Rucio has evolved into a successful open-source project that is now being used by many scientific communities and organisations. Rucio is incorporating the contributions and expertise of many scientific projects and is offering common features useful to a diverse research community. This article describes the recent experiences in operating Rucio, as well as contributions to the project, by ATLAS, Belle II, CMS, ESCAPE, IGWN, LDMX, Folding@Home, and the UK’s Science and Technology Facilities Council (STFC).ATL-SOFT-PROC-2021-009FERMILAB-CONF-21-753-SCDoai:cds.cern.ch:27725062021-06-11
spellingShingle Particle Physics - Experiment
Computing and Computers
Barisits, Martin
Beermann, Thomas
Cameron, David
Clark, James Alexander
Di Maria, Riccardo
Fronzé, Gabriele Gaetano
Johnson, Ian
Lassnig, Mario
Serfon, Cédric
Vaandering, Eric W
Experience with Rucio in the wider HEP community
title Experience with Rucio in the wider HEP community
title_full Experience with Rucio in the wider HEP community
title_fullStr Experience with Rucio in the wider HEP community
title_full_unstemmed Experience with Rucio in the wider HEP community
title_short Experience with Rucio in the wider HEP community
title_sort experience with rucio in the wider hep community
topic Particle Physics - Experiment
Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202125102030
http://cds.cern.ch/record/2772506
work_keys_str_mv AT barisitsmartin experiencewithruciointhewiderhepcommunity
AT beermannthomas experiencewithruciointhewiderhepcommunity
AT camerondavid experiencewithruciointhewiderhepcommunity
AT clarkjamesalexander experiencewithruciointhewiderhepcommunity
AT dimariariccardo experiencewithruciointhewiderhepcommunity
AT fronzegabrielegaetano experiencewithruciointhewiderhepcommunity
AT johnsonian experiencewithruciointhewiderhepcommunity
AT lassnigmario experiencewithruciointhewiderhepcommunity
AT serfoncedric experiencewithruciointhewiderhepcommunity
AT vaanderingericw experiencewithruciointhewiderhepcommunity