Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS

Mostrar otras versiones (1)

Rucio, the distributed data management system of the ATLAS collaboration already manages more than 330 Petabytes of physics data on the grid. Rucio has seen incremental improvements throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements...

Descripción completa

Detalles Bibliográficos
Autores principales: Barisits, Martin-Stefan, Beermann, Thomas Alfons, Bogado Garcia, Joaquin Ignacio, Garonne, Vincent, Javurek, Tomas, Lassnig, Mario, Serfon, Cedric, Wegner, Tobias Thomas
Lenguaje:eng
Publicado: 2018
Materias:
Particle Physics - Experiment
Acceso en línea:http://cds.cern.ch/record/2625457
_version_ 1780958789911969792
author Barisits, Martin-Stefan
Beermann, Thomas Alfons
Bogado Garcia, Joaquin Ignacio
Garonne, Vincent
Javurek, Tomas
Lassnig, Mario
Serfon, Cedric
Wegner, Tobias Thomas
author_facet Barisits, Martin-Stefan
Beermann, Thomas Alfons
Bogado Garcia, Joaquin Ignacio
Garonne, Vincent
Javurek, Tomas
Lassnig, Mario
Serfon, Cedric
Wegner, Tobias Thomas
author_sort Barisits, Martin-Stefan
collection CERN
description Rucio, the distributed data management system of the ATLAS collaboration already manages more than 330 Petabytes of physics data on the grid. Rucio has seen incremental improvements throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements the system is currently evolving into a full-scale generic data management system for application beyond ATLAS, or even beyond high energy physics. This contribution focuses on the development roadmap of Rucio for LHC Run-3, such as, event level data management, generic meta-data support, and increased usage of networks and tapes. At the same time Rucio is evolving beyond the original ATLAS use-case. This includes authentication beyond the WLCG ecosystem, generic database compatibility, deployment and packaging of the software stack in containers and a project paradigm shift to a full-scale open source project.
id cern-2625457
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26254572019-11-11T14:30:30Zhttp://cds.cern.ch/record/2625457engBarisits, Martin-StefanBeermann, Thomas AlfonsBogado Garcia, Joaquin IgnacioGaronne, VincentJavurek, TomasLassnig, MarioSerfon, CedricWegner, Tobias ThomasEvolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLASParticle Physics - ExperimentRucio, the distributed data management system of the ATLAS collaboration already manages more than 330 Petabytes of physics data on the grid. Rucio has seen incremental improvements throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment. Next to these improvements the system is currently evolving into a full-scale generic data management system for application beyond ATLAS, or even beyond high energy physics. This contribution focuses on the development roadmap of Rucio for LHC Run-3, such as, event level data management, generic meta-data support, and increased usage of networks and tapes. At the same time Rucio is evolving beyond the original ATLAS use-case. This includes authentication beyond the WLCG ecosystem, generic database compatibility, deployment and packaging of the software stack in containers and a project paradigm shift to a full-scale open source project.ATL-SOFT-SLIDE-2018-401oai:cds.cern.ch:26254572018-06-24
spellingShingle Particle Physics - Experiment
Barisits, Martin-Stefan
Beermann, Thomas Alfons
Bogado Garcia, Joaquin Ignacio
Garonne, Vincent
Javurek, Tomas
Lassnig, Mario
Serfon, Cedric
Wegner, Tobias Thomas
Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_full Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_fullStr Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_full_unstemmed Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_short Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
title_sort evolution of the open-source data management system rucio for lhc run-3 and beyond atlas
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2625457
work_keys_str_mv AT barisitsmartinstefan evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT beermannthomasalfons evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT bogadogarciajoaquinignacio evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT garonnevincent evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT javurektomas evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT lassnigmario evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT serfoncedric evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas
AT wegnertobiasthomas evolutionoftheopensourcedatamanagementsystemrucioforlhcrun3andbeyondatlas

Ejemplares similares