Cargando…

ATLAS production system

The second generation of the ATLAS production system called ProdSys2 is a distributed workload manager which used by thousands of physicists to analyze the data remotely, with the volume of processed data is beyond the exabyte scale, across a more than hundred heterogeneous sites. It achieves high u...

Descripción completa

Detalles Bibliográficos
Autores principales: Borodin, Mikhail, Barreiro Megino, Fernando Harald, De, Kaushik, Klimentov, Alexei, Golubkov, Dmitry, Maeno, Tadashi, Mashinistov, Ruslan, Wenaus, Torre, Padolski, Siarhei
Lenguaje:eng
Publicado: 2016
Materias:
Acceso en línea:http://cds.cern.ch/record/2195766
Descripción
Sumario:The second generation of the ATLAS production system called ProdSys2 is a distributed workload manager which used by thousands of physicists to analyze the data remotely, with the volume of processed data is beyond the exabyte scale, across a more than hundred heterogeneous sites. It achieves high utilization by combining dynamic job definition based on many criterias, such as input and output size, memory requirements and CPU consumption with manageable scheduling policies and by supporting different kind of computational resources, such as GRID, clouds, supercomputers and volunteering computers. Besides jobs definition Production System also includes flexible web user interface, which implements user-friendly environment for main ATLAS workflows, e.g. simple way of combining different data flows, and real-time monitoring, optimised for using with huge amount of information to present. We present an overview of the ATLAS Production System major components: job and task definition, workflow manager web user interface. We describe the important design decisions, and lessons learned from an operational experience during the first years of LHC Run2.