Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS

Mostrar otras versiones (1)

Rucio, the distributed data management system of the ATLAS experiment already manages more than 400 Petabytes of physics data on the grid. Rucio was incrementally improved throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements the system...

Descripción completa

Detalles Bibliográficos
Autores principales: Barisits, Martin, Beermann, Thomas Alfons, Bogado Garcia, Joaquin Ignacio, Garonne, Vincent, Javurek, Tomas, Lassnig, Mario, Manzi, Andrea, Martelli, Edoardo, Serfon, Cedric, Wegner, Tobias Thomas, Zhao, Xin
Lenguaje:eng
Publicado: 2018
Materias:
Particle Physics - Experiment
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921404054
http://cds.cern.ch/record/2649759
_version_ 1780960754331025408
author Barisits, Martin
Beermann, Thomas Alfons
Bogado Garcia, Joaquin Ignacio
Garonne, Vincent
Javurek, Tomas
Lassnig, Mario
Manzi, Andrea
Martelli, Edoardo
Serfon, Cedric
Wegner, Tobias Thomas
Zhao, Xin
author_facet Barisits, Martin
Beermann, Thomas Alfons
Bogado Garcia, Joaquin Ignacio
Garonne, Vincent
Javurek, Tomas
Lassnig, Mario
Manzi, Andrea
Martelli, Edoardo
Serfon, Cedric
Wegner, Tobias Thomas
Zhao, Xin
author_sort Barisits, Martin
collection CERN
description Rucio, the distributed data management system of the ATLAS experiment already manages more than 400 Petabytes of physics data on the grid. Rucio was incrementally improved throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements the system is currently evolving into a full-scale generic data management system for application beyond ATLAS, or even beyond high-energy physics. This contribution focuses on the development roadmap of Rucio for LHC Run-3, such as event level data management, generic meta-data support and increased usage of networks and tapes. At the same time Rucio is evolving beyond the original ATLAS requirements. This includes additional authentication mechanisms, generic database compatibility, deployment and packaging of the software stack in containers, and a project paradigm shift to a full-scale open source project.
id cern-2649759
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26497592022-08-10T12:27:30Zdoi:10.1051/epjconf/201921404054http://cds.cern.ch/record/2649759engBarisits, MartinBeermann, Thomas AlfonsBogado Garcia, Joaquin IgnacioGaronne, VincentJavurek, TomasLassnig, MarioManzi, AndreaMartelli, EdoardoSerfon, CedricWegner, Tobias ThomasZhao, XinEvolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLASParticle Physics - ExperimentRucio, the distributed data management system of the ATLAS experiment already manages more than 400 Petabytes of physics data on the grid. Rucio was incrementally improved throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements the system is currently evolving into a full-scale generic data management system for application beyond ATLAS, or even beyond high-energy physics. This contribution focuses on the development roadmap of Rucio for LHC Run-3, such as event level data management, generic meta-data support and increased usage of networks and tapes. At the same time Rucio is evolving beyond the original ATLAS requirements. This includes additional authentication mechanisms, generic database compatibility, deployment and packaging of the software stack in containers, and a project paradigm shift to a full-scale open source project.ATL-SOFT-PROC-2018-055oai:cds.cern.ch:26497592018-12-03
spellingShingle Particle Physics - Experiment
Barisits, Martin
Beermann, Thomas Alfons
Bogado Garcia, Joaquin Ignacio
Garonne, Vincent
Javurek, Tomas
Lassnig, Mario
Manzi, Andrea
Martelli, Edoardo
Serfon, Cedric
Wegner, Tobias Thomas
Zhao, Xin
Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_full Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_fullStr Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_full_unstemmed Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_short Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_sort evolution of the open-source data management system rucio for lhc run-3 and beyond atlas
topic Particle Physics - Experiment
url https://dx.doi.org/10.1051/epjconf/201921404054
http://cds.cern.ch/record/2649759
work_keys_str_mv AT barisitsmartin evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT beermannthomasalfons evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT bogadogarciajoaquinignacio evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT garonnevincent evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT javurektomas evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT lassnigmario evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT manziandrea evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT martelliedoardo evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT serfoncedric evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT wegnertobiasthomas evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT zhaoxin evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas

Ejemplares similares