Cargando…

Operation of the ATLAS distributed computing

We describe the central operation of the ATLAS distributed computing system. The majority of compute intensive activities within ATLAS are carried out on some 350,000 CPU cores on the Grid, augmented by opportunistic usage of significant HPC and volunteer resources. The increasing scale, and challen...

Descripción completa

Detalles Bibliográficos
Autores principales: Barreiro Megino, Fernando Harald, Cameron, David, Di Girolamo, Alessandro, Glushkov, Ivan, Filipcic, Andrej, Legger, Federica, Maeno, Tadashi, Walker, Rodney
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:http://cds.cern.ch/record/2626049
_version_ 1780958822859276288
author Barreiro Megino, Fernando Harald
Cameron, David
Di Girolamo, Alessandro
Glushkov, Ivan
Filipcic, Andrej
Legger, Federica
Maeno, Tadashi
Walker, Rodney
author_facet Barreiro Megino, Fernando Harald
Cameron, David
Di Girolamo, Alessandro
Glushkov, Ivan
Filipcic, Andrej
Legger, Federica
Maeno, Tadashi
Walker, Rodney
author_sort Barreiro Megino, Fernando Harald
collection CERN
description We describe the central operation of the ATLAS distributed computing system. The majority of compute intensive activities within ATLAS are carried out on some 350,000 CPU cores on the Grid, augmented by opportunistic usage of significant HPC and volunteer resources. The increasing scale, and challenging new payloads, demand fine-tuning of operational procedures together with timely developments of the production system. We describe several such developments, motivated directly from operational experience. Optimization of inefficient task requests, from both official production and users, is made possible by automatic detection of payload properties. User education, job shaping or preventative throttling help to increase the overall throughput of the available resources.
id cern-2626049
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26260492019-11-13T12:34:54Zhttp://cds.cern.ch/record/2626049engBarreiro Megino, Fernando HaraldCameron, DavidDi Girolamo, AlessandroGlushkov, IvanFilipcic, AndrejLegger, FedericaMaeno, TadashiWalker, RodneyOperation of the ATLAS distributed computingParticle Physics - ExperimentWe describe the central operation of the ATLAS distributed computing system. The majority of compute intensive activities within ATLAS are carried out on some 350,000 CPU cores on the Grid, augmented by opportunistic usage of significant HPC and volunteer resources. The increasing scale, and challenging new payloads, demand fine-tuning of operational procedures together with timely developments of the production system. We describe several such developments, motivated directly from operational experience. Optimization of inefficient task requests, from both official production and users, is made possible by automatic detection of payload properties. User education, job shaping or preventative throttling help to increase the overall throughput of the available resources.ATL-SOFT-SLIDE-2018-405oai:cds.cern.ch:26260492018-06-25
spellingShingle Particle Physics - Experiment
Barreiro Megino, Fernando Harald
Cameron, David
Di Girolamo, Alessandro
Glushkov, Ivan
Filipcic, Andrej
Legger, Federica
Maeno, Tadashi
Walker, Rodney
Operation of the ATLAS distributed computing
title Operation of the ATLAS distributed computing
title_full Operation of the ATLAS distributed computing
title_fullStr Operation of the ATLAS distributed computing
title_full_unstemmed Operation of the ATLAS distributed computing
title_short Operation of the ATLAS distributed computing
title_sort operation of the atlas distributed computing
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2626049
work_keys_str_mv AT barreiromeginofernandoharald operationoftheatlasdistributedcomputing
AT camerondavid operationoftheatlasdistributedcomputing
AT digirolamoalessandro operationoftheatlasdistributedcomputing
AT glushkovivan operationoftheatlasdistributedcomputing
AT filipcicandrej operationoftheatlasdistributedcomputing
AT leggerfederica operationoftheatlasdistributedcomputing
AT maenotadashi operationoftheatlasdistributedcomputing
AT walkerrodney operationoftheatlasdistributedcomputing