Cargando…

ATLAS production system

The second generation of the ATLAS production system called ProdSys2 is a distributed workload manager which used by thousands of physicists to analyze the data remotely, with the volume of processed data is beyond the exabyte scale, across a more than hundred heterogeneous sites. It achieves high u...

Descripción completa

Detalles Bibliográficos
Autores principales: Borodin, Mikhail, Barreiro Megino, Fernando Harald, De, Kaushik, Klimentov, Alexei, Golubkov, Dmitry, Maeno, Tadashi, Mashinistov, Ruslan, Wenaus, Torre, Padolski, Siarhei
Lenguaje:eng
Publicado: 2016
Materias:
Acceso en línea:http://cds.cern.ch/record/2195766
_version_ 1780951072989249536
author Borodin, Mikhail
Barreiro Megino, Fernando Harald
De, Kaushik
Klimentov, Alexei
Golubkov, Dmitry
Maeno, Tadashi
Mashinistov, Ruslan
Wenaus, Torre
Padolski, Siarhei
author_facet Borodin, Mikhail
Barreiro Megino, Fernando Harald
De, Kaushik
Klimentov, Alexei
Golubkov, Dmitry
Maeno, Tadashi
Mashinistov, Ruslan
Wenaus, Torre
Padolski, Siarhei
author_sort Borodin, Mikhail
collection CERN
description The second generation of the ATLAS production system called ProdSys2 is a distributed workload manager which used by thousands of physicists to analyze the data remotely, with the volume of processed data is beyond the exabyte scale, across a more than hundred heterogeneous sites. It achieves high utilization by combining dynamic job definition based on many criterias, such as input and output size, memory requirements and CPU consumption with manageable scheduling policies and by supporting different kind of computational resources, such as GRID, clouds, supercomputers and volunteering computers. Besides jobs definition Production System also includes flexible web user interface, which implements user-friendly environment for main ATLAS workflows, e.g. simple way of combining different data flows, and real-time monitoring, optimised for using with huge amount of information to present. We present an overview of the ATLAS Production System major components: job and task definition, workflow manager web user interface. We describe the important design decisions, and lessons learned from an operational experience during the first years of LHC Run2.
id cern-2195766
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2016
record_format invenio
spelling cern-21957662019-09-30T06:29:59Zhttp://cds.cern.ch/record/2195766engBorodin, MikhailBarreiro Megino, Fernando HaraldDe, KaushikKlimentov, AlexeiGolubkov, DmitryMaeno, TadashiMashinistov, RuslanWenaus, TorrePadolski, SiarheiATLAS production systemParticle Physics - ExperimentThe second generation of the ATLAS production system called ProdSys2 is a distributed workload manager which used by thousands of physicists to analyze the data remotely, with the volume of processed data is beyond the exabyte scale, across a more than hundred heterogeneous sites. It achieves high utilization by combining dynamic job definition based on many criterias, such as input and output size, memory requirements and CPU consumption with manageable scheduling policies and by supporting different kind of computational resources, such as GRID, clouds, supercomputers and volunteering computers. Besides jobs definition Production System also includes flexible web user interface, which implements user-friendly environment for main ATLAS workflows, e.g. simple way of combining different data flows, and real-time monitoring, optimised for using with huge amount of information to present. We present an overview of the ATLAS Production System major components: job and task definition, workflow manager web user interface. We describe the important design decisions, and lessons learned from an operational experience during the first years of LHC Run2.ATL-SOFT-SLIDE-2016-369oai:cds.cern.ch:21957662016-07-01
spellingShingle Particle Physics - Experiment
Borodin, Mikhail
Barreiro Megino, Fernando Harald
De, Kaushik
Klimentov, Alexei
Golubkov, Dmitry
Maeno, Tadashi
Mashinistov, Ruslan
Wenaus, Torre
Padolski, Siarhei
ATLAS production system
title ATLAS production system
title_full ATLAS production system
title_fullStr ATLAS production system
title_full_unstemmed ATLAS production system
title_short ATLAS production system
title_sort atlas production system
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2195766
work_keys_str_mv AT borodinmikhail atlasproductionsystem
AT barreiromeginofernandoharald atlasproductionsystem
AT dekaushik atlasproductionsystem
AT klimentovalexei atlasproductionsystem
AT golubkovdmitry atlasproductionsystem
AT maenotadashi atlasproductionsystem
AT mashinistovruslan atlasproductionsystem
AT wenaustorre atlasproductionsystem
AT padolskisiarhei atlasproductionsystem