Cargando…
ATLAS production system
The second generation of the ATLAS production system called ProdSys2 is a distributed workload manager which used by thousands of physicists to analyze the data remotely, with the volume of processed data is beyond the exabyte scale, across a more than hundred heterogeneous sites. It achieves high u...
Autores principales: | , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2016
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2195766 |
_version_ | 1780951072989249536 |
---|---|
author | Borodin, Mikhail Barreiro Megino, Fernando Harald De, Kaushik Klimentov, Alexei Golubkov, Dmitry Maeno, Tadashi Mashinistov, Ruslan Wenaus, Torre Padolski, Siarhei |
author_facet | Borodin, Mikhail Barreiro Megino, Fernando Harald De, Kaushik Klimentov, Alexei Golubkov, Dmitry Maeno, Tadashi Mashinistov, Ruslan Wenaus, Torre Padolski, Siarhei |
author_sort | Borodin, Mikhail |
collection | CERN |
description | The second generation of the ATLAS production system called ProdSys2 is a distributed workload manager which used by thousands of physicists to analyze the data remotely, with the volume of processed data is beyond the exabyte scale, across a more than hundred heterogeneous sites. It achieves high utilization by combining dynamic job definition based on many criterias, such as input and output size, memory requirements and CPU consumption with manageable scheduling policies and by supporting different kind of computational resources, such as GRID, clouds, supercomputers and volunteering computers. Besides jobs definition Production System also includes flexible web user interface, which implements user-friendly environment for main ATLAS workflows, e.g. simple way of combining different data flows, and real-time monitoring, optimised for using with huge amount of information to present. We present an overview of the ATLAS Production System major components: job and task definition, workflow manager web user interface. We describe the important design decisions, and lessons learned from an operational experience during the first years of LHC Run2. |
id | cern-2195766 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2016 |
record_format | invenio |
spelling | cern-21957662019-09-30T06:29:59Zhttp://cds.cern.ch/record/2195766engBorodin, MikhailBarreiro Megino, Fernando HaraldDe, KaushikKlimentov, AlexeiGolubkov, DmitryMaeno, TadashiMashinistov, RuslanWenaus, TorrePadolski, SiarheiATLAS production systemParticle Physics - ExperimentThe second generation of the ATLAS production system called ProdSys2 is a distributed workload manager which used by thousands of physicists to analyze the data remotely, with the volume of processed data is beyond the exabyte scale, across a more than hundred heterogeneous sites. It achieves high utilization by combining dynamic job definition based on many criterias, such as input and output size, memory requirements and CPU consumption with manageable scheduling policies and by supporting different kind of computational resources, such as GRID, clouds, supercomputers and volunteering computers. Besides jobs definition Production System also includes flexible web user interface, which implements user-friendly environment for main ATLAS workflows, e.g. simple way of combining different data flows, and real-time monitoring, optimised for using with huge amount of information to present. We present an overview of the ATLAS Production System major components: job and task definition, workflow manager web user interface. We describe the important design decisions, and lessons learned from an operational experience during the first years of LHC Run2.ATL-SOFT-SLIDE-2016-369oai:cds.cern.ch:21957662016-07-01 |
spellingShingle | Particle Physics - Experiment Borodin, Mikhail Barreiro Megino, Fernando Harald De, Kaushik Klimentov, Alexei Golubkov, Dmitry Maeno, Tadashi Mashinistov, Ruslan Wenaus, Torre Padolski, Siarhei ATLAS production system |
title | ATLAS production system |
title_full | ATLAS production system |
title_fullStr | ATLAS production system |
title_full_unstemmed | ATLAS production system |
title_short | ATLAS production system |
title_sort | atlas production system |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2195766 |
work_keys_str_mv | AT borodinmikhail atlasproductionsystem AT barreiromeginofernandoharald atlasproductionsystem AT dekaushik atlasproductionsystem AT klimentovalexei atlasproductionsystem AT golubkovdmitry atlasproductionsystem AT maenotadashi atlasproductionsystem AT mashinistovruslan atlasproductionsystem AT wenaustorre atlasproductionsystem AT padolskisiarhei atlasproductionsystem |