Cargando…
Seamless integration of commercial Clouds with ATLAS Distributed Computing
The CERN ATLAS Experiment successfully uses a worldwide distributed computing Grid infrastructure to support its physics programme at the Large Hadron Collider (LHC). The Grid workflow system PanDA routinely manages up to 700,000 concurrently running production and analysis jobs to process simulatio...
Autores principales: | , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2021
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202125102005 http://cds.cern.ch/record/2813811 |
_version_ | 1780973422735523840 |
---|---|
author | Barreiro Megino, Fernando Bawa, Harinder Singh De, Kaushik Elmsheuser, Johannes Klimentov, Alexei Lassnig, Mario Serfon, Cédric Wegner, Tobias |
author_facet | Barreiro Megino, Fernando Bawa, Harinder Singh De, Kaushik Elmsheuser, Johannes Klimentov, Alexei Lassnig, Mario Serfon, Cédric Wegner, Tobias |
author_sort | Barreiro Megino, Fernando |
collection | CERN |
description | The CERN ATLAS Experiment successfully uses a worldwide distributed computing Grid infrastructure to support its physics programme at the Large Hadron Collider (LHC). The Grid workflow system PanDA routinely manages up to 700,000 concurrently running production and analysis jobs to process simulation and detector data. In total more than 500 PB of data are distributed over more than 150 sites in the WLCG and handled by the ATLAS data management system Rucio. To prepare for the ever growing data rate in future LHC runs new developments are underway to embrace industry accepted protocols and technologies, and utilize opportunistic resources in a standard way. This paper reviews how the Google and Amazon Cloud computing services have been seamlessly integrated as a Grid site within PanDA and Rucio. Performance and brief cost evaluations will be discussed. Such setups could offer advanced Cloud tool-sets and provide added value for analysis facilities that are under discussions for LHC Run-4. |
id | cern-2813811 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2021 |
record_format | invenio |
spelling | cern-28138112022-08-23T08:47:44Zdoi:10.1051/epjconf/202125102005http://cds.cern.ch/record/2813811engBarreiro Megino, Fernando Bawa, Harinder SinghDe, KaushikElmsheuser, JohannesKlimentov, AlexeiLassnig, MarioSerfon, CédricWegner, TobiasSeamless integration of commercial Clouds with ATLAS Distributed ComputingComputing and ComputersThe CERN ATLAS Experiment successfully uses a worldwide distributed computing Grid infrastructure to support its physics programme at the Large Hadron Collider (LHC). The Grid workflow system PanDA routinely manages up to 700,000 concurrently running production and analysis jobs to process simulation and detector data. In total more than 500 PB of data are distributed over more than 150 sites in the WLCG and handled by the ATLAS data management system Rucio. To prepare for the ever growing data rate in future LHC runs new developments are underway to embrace industry accepted protocols and technologies, and utilize opportunistic resources in a standard way. This paper reviews how the Google and Amazon Cloud computing services have been seamlessly integrated as a Grid site within PanDA and Rucio. Performance and brief cost evaluations will be discussed. Such setups could offer advanced Cloud tool-sets and provide added value for analysis facilities that are under discussions for LHC Run-4.oai:cds.cern.ch:28138112021 |
spellingShingle | Computing and Computers Barreiro Megino, Fernando Bawa, Harinder Singh De, Kaushik Elmsheuser, Johannes Klimentov, Alexei Lassnig, Mario Serfon, Cédric Wegner, Tobias Seamless integration of commercial Clouds with ATLAS Distributed Computing |
title | Seamless integration of commercial Clouds with ATLAS Distributed Computing |
title_full | Seamless integration of commercial Clouds with ATLAS Distributed Computing |
title_fullStr | Seamless integration of commercial Clouds with ATLAS Distributed Computing |
title_full_unstemmed | Seamless integration of commercial Clouds with ATLAS Distributed Computing |
title_short | Seamless integration of commercial Clouds with ATLAS Distributed Computing |
title_sort | seamless integration of commercial clouds with atlas distributed computing |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202125102005 http://cds.cern.ch/record/2813811 |
work_keys_str_mv | AT barreiromeginofernando seamlessintegrationofcommercialcloudswithatlasdistributedcomputing AT bawaharindersingh seamlessintegrationofcommercialcloudswithatlasdistributedcomputing AT dekaushik seamlessintegrationofcommercialcloudswithatlasdistributedcomputing AT elmsheuserjohannes seamlessintegrationofcommercialcloudswithatlasdistributedcomputing AT klimentovalexei seamlessintegrationofcommercialcloudswithatlasdistributedcomputing AT lassnigmario seamlessintegrationofcommercialcloudswithatlasdistributedcomputing AT serfoncedric seamlessintegrationofcommercialcloudswithatlasdistributedcomputing AT wegnertobias seamlessintegrationofcommercialcloudswithatlasdistributedcomputing |