Cargando…

Seamless integration of commercial Clouds with ATLAS Distributed Computing

The CERN ATLAS Experiment successfully uses a worldwide distributed computing Grid infrastructure to support its physics programme at the Large Hadron Collider (LHC). The Grid workflow system PanDA routinely manages up to 700,000 concurrently running production and analysis jobs to process simulatio...

Descripción completa

Detalles Bibliográficos
Autores principales: Barreiro Megino, Fernando , Bawa, Harinder Singh, De, Kaushik, Elmsheuser, Johannes, Klimentov, Alexei, Lassnig, Mario, Serfon, Cédric, Wegner, Tobias
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202125102005
http://cds.cern.ch/record/2813811
_version_ 1780973422735523840
author Barreiro Megino, Fernando 
Bawa, Harinder Singh
De, Kaushik
Elmsheuser, Johannes
Klimentov, Alexei
Lassnig, Mario
Serfon, Cédric
Wegner, Tobias
author_facet Barreiro Megino, Fernando 
Bawa, Harinder Singh
De, Kaushik
Elmsheuser, Johannes
Klimentov, Alexei
Lassnig, Mario
Serfon, Cédric
Wegner, Tobias
author_sort Barreiro Megino, Fernando 
collection CERN
description The CERN ATLAS Experiment successfully uses a worldwide distributed computing Grid infrastructure to support its physics programme at the Large Hadron Collider (LHC). The Grid workflow system PanDA routinely manages up to 700,000 concurrently running production and analysis jobs to process simulation and detector data. In total more than 500 PB of data are distributed over more than 150 sites in the WLCG and handled by the ATLAS data management system Rucio. To prepare for the ever growing data rate in future LHC runs new developments are underway to embrace industry accepted protocols and technologies, and utilize opportunistic resources in a standard way. This paper reviews how the Google and Amazon Cloud computing services have been seamlessly integrated as a Grid site within PanDA and Rucio. Performance and brief cost evaluations will be discussed. Such setups could offer advanced Cloud tool-sets and provide added value for analysis facilities that are under discussions for LHC Run-4.
id cern-2813811
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-28138112022-08-23T08:47:44Zdoi:10.1051/epjconf/202125102005http://cds.cern.ch/record/2813811engBarreiro Megino, Fernando Bawa, Harinder SinghDe, KaushikElmsheuser, JohannesKlimentov, AlexeiLassnig, MarioSerfon, CédricWegner, TobiasSeamless integration of commercial Clouds with ATLAS Distributed ComputingComputing and ComputersThe CERN ATLAS Experiment successfully uses a worldwide distributed computing Grid infrastructure to support its physics programme at the Large Hadron Collider (LHC). The Grid workflow system PanDA routinely manages up to 700,000 concurrently running production and analysis jobs to process simulation and detector data. In total more than 500 PB of data are distributed over more than 150 sites in the WLCG and handled by the ATLAS data management system Rucio. To prepare for the ever growing data rate in future LHC runs new developments are underway to embrace industry accepted protocols and technologies, and utilize opportunistic resources in a standard way. This paper reviews how the Google and Amazon Cloud computing services have been seamlessly integrated as a Grid site within PanDA and Rucio. Performance and brief cost evaluations will be discussed. Such setups could offer advanced Cloud tool-sets and provide added value for analysis facilities that are under discussions for LHC Run-4.oai:cds.cern.ch:28138112021
spellingShingle Computing and Computers
Barreiro Megino, Fernando 
Bawa, Harinder Singh
De, Kaushik
Elmsheuser, Johannes
Klimentov, Alexei
Lassnig, Mario
Serfon, Cédric
Wegner, Tobias
Seamless integration of commercial Clouds with ATLAS Distributed Computing
title Seamless integration of commercial Clouds with ATLAS Distributed Computing
title_full Seamless integration of commercial Clouds with ATLAS Distributed Computing
title_fullStr Seamless integration of commercial Clouds with ATLAS Distributed Computing
title_full_unstemmed Seamless integration of commercial Clouds with ATLAS Distributed Computing
title_short Seamless integration of commercial Clouds with ATLAS Distributed Computing
title_sort seamless integration of commercial clouds with atlas distributed computing
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202125102005
http://cds.cern.ch/record/2813811
work_keys_str_mv AT barreiromeginofernando seamlessintegrationofcommercialcloudswithatlasdistributedcomputing
AT bawaharindersingh seamlessintegrationofcommercialcloudswithatlasdistributedcomputing
AT dekaushik seamlessintegrationofcommercialcloudswithatlasdistributedcomputing
AT elmsheuserjohannes seamlessintegrationofcommercialcloudswithatlasdistributedcomputing
AT klimentovalexei seamlessintegrationofcommercialcloudswithatlasdistributedcomputing
AT lassnigmario seamlessintegrationofcommercialcloudswithatlasdistributedcomputing
AT serfoncedric seamlessintegrationofcommercialcloudswithatlasdistributedcomputing
AT wegnertobias seamlessintegrationofcommercialcloudswithatlasdistributedcomputing