Cargando…

ATLAS WORLD-cloud and networking in PanDA

The ATLAS computing model was originally designed as static clouds (usually national or geographical groupings of sites) around the Tier 1 centres, which confined tasks and most of the data traffic. Since those early days, the sites' network bandwidth has increased at 0(1000) and the difference...

Descripción completa

Detalles Bibliográficos
Autores principales: Barreiro Megino, Fernando Harald, De, Kaushik, Di Girolamo, Alessandro, Maeno, Tadashi, Walker, Rodney
Lenguaje:eng
Publicado: 2017
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/898/5/052011
http://cds.cern.ch/record/2240698
_version_ 1780953101801357312
author Barreiro Megino, Fernando Harald
De, Kaushik
Di Girolamo, Alessandro
Maeno, Tadashi
Walker, Rodney
author_facet Barreiro Megino, Fernando Harald
De, Kaushik
Di Girolamo, Alessandro
Maeno, Tadashi
Walker, Rodney
author_sort Barreiro Megino, Fernando Harald
collection CERN
description The ATLAS computing model was originally designed as static clouds (usually national or geographical groupings of sites) around the Tier 1 centres, which confined tasks and most of the data traffic. Since those early days, the sites' network bandwidth has increased at 0(1000) and the difference in functionalities between Tier 1s and Tier 2s has reduced. After years of manual, intermediate solutions, we have now ramped up to full usage of World-cloud, the latest step in the PanDA Workload Management System to increase resource utilization on the ATLAS Grid, for all workflows (MC production, data (re)processing, etc.). We have based the development on two new site concepts. Nuclei sites are the Tier 1s and large Tier 2s, where tasks will be assigned and the output aggregated, and satellites are the sites that will execute the jobs and send the output to their nucleus. PanDA dynamically pairs nuclei and satellite sites for each task based on the input data availability, capability matching, site load and network connectivity. This contribution will introduce the conceptual changes for World-cloud, the development necessary in PanDA, an insight into the network model and the first half-year of operational experience.
id cern-2240698
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2017
record_format invenio
spelling cern-22406982019-10-15T15:16:59Zdoi:10.1088/1742-6596/898/5/052011http://cds.cern.ch/record/2240698engBarreiro Megino, Fernando HaraldDe, KaushikDi Girolamo, AlessandroMaeno, TadashiWalker, RodneyATLAS WORLD-cloud and networking in PanDAParticle Physics - ExperimentThe ATLAS computing model was originally designed as static clouds (usually national or geographical groupings of sites) around the Tier 1 centres, which confined tasks and most of the data traffic. Since those early days, the sites' network bandwidth has increased at 0(1000) and the difference in functionalities between Tier 1s and Tier 2s has reduced. After years of manual, intermediate solutions, we have now ramped up to full usage of World-cloud, the latest step in the PanDA Workload Management System to increase resource utilization on the ATLAS Grid, for all workflows (MC production, data (re)processing, etc.). We have based the development on two new site concepts. Nuclei sites are the Tier 1s and large Tier 2s, where tasks will be assigned and the output aggregated, and satellites are the sites that will execute the jobs and send the output to their nucleus. PanDA dynamically pairs nuclei and satellite sites for each task based on the input data availability, capability matching, site load and network connectivity. This contribution will introduce the conceptual changes for World-cloud, the development necessary in PanDA, an insight into the network model and the first half-year of operational experience.ATL-SOFT-PROC-2017-008oai:cds.cern.ch:22406982017-01-08
spellingShingle Particle Physics - Experiment
Barreiro Megino, Fernando Harald
De, Kaushik
Di Girolamo, Alessandro
Maeno, Tadashi
Walker, Rodney
ATLAS WORLD-cloud and networking in PanDA
title ATLAS WORLD-cloud and networking in PanDA
title_full ATLAS WORLD-cloud and networking in PanDA
title_fullStr ATLAS WORLD-cloud and networking in PanDA
title_full_unstemmed ATLAS WORLD-cloud and networking in PanDA
title_short ATLAS WORLD-cloud and networking in PanDA
title_sort atlas world-cloud and networking in panda
topic Particle Physics - Experiment
url https://dx.doi.org/10.1088/1742-6596/898/5/052011
http://cds.cern.ch/record/2240698
work_keys_str_mv AT barreiromeginofernandoharald atlasworldcloudandnetworkinginpanda
AT dekaushik atlasworldcloudandnetworkinginpanda
AT digirolamoalessandro atlasworldcloudandnetworkinginpanda
AT maenotadashi atlasworldcloudandnetworkinginpanda
AT walkerrodney atlasworldcloudandnetworkinginpanda