Cargando…

Multi-core job submission and grid resource scheduling for ATLAS AthenaMP

AthenaMP is the multi-core implementation of the ATLAS software framework and allows the efficient sharing of memory pages between multiple threads of execution. This has now been validated for production and delivers a significant reduction on overall memory footprint with negligible CPU overhead....

Descripción completa

Detalles Bibliográficos
Autores principales: Crooks, D, Calafiura, P, Harrington, R, Purdie, S, Severini, H, Skipsey, S, Tsulaia, V, Washbrook, A
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/396/3/032115
http://cds.cern.ch/record/1449084
_version_ 1780924874679648256
author Crooks, D
Calafiura, P
Harrington, R
Purdie, S
Severini, H
Skipsey, S
Tsulaia, V
Washbrook, A
author_facet Crooks, D
Calafiura, P
Harrington, R
Purdie, S
Severini, H
Skipsey, S
Tsulaia, V
Washbrook, A
author_sort Crooks, D
collection CERN
description AthenaMP is the multi-core implementation of the ATLAS software framework and allows the efficient sharing of memory pages between multiple threads of execution. This has now been validated for production and delivers a significant reduction on overall memory footprint with negligible CPU overhead. Before AthenaMP can be routinely run on the LHC Computing Grid, it must be determined how the computing resources available to ATLAS can best exploit the notable improvements delivered by switching to this multi-process model. In particular, there is a need to identify and assess the potential impact of scheduling issues where single core and multi-core job queues have access to the same underlying resources. A study into the effectiveness and scalability of AthenaMP in a production environment will be presented. Submitting AthenaMP tasks to the Tier-0 and candidate Tier-2 sites will allow detailed measurement of worker node performance and also highlight the relative performance of local resource management systems (LRMS) in handling large volumes of multi-core jobs. Best practices for configuring the main LRMS implementations currently used by Tier-2 sites will be identified in the context of multi-core job optimisation. There will also be a discussion on how existing Grid middleware and the ATLAS job submission pilot model could use scheduling information to increase the overall efficiency of multi-core job throughput.
id cern-1449084
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14490842019-09-30T06:29:59Zdoi:10.1088/1742-6596/396/3/032115http://cds.cern.ch/record/1449084engCrooks, DCalafiura, PHarrington, RPurdie, SSeverini, HSkipsey, STsulaia, VWashbrook, AMulti-core job submission and grid resource scheduling for ATLAS AthenaMPDetectors and Experimental TechniquesAthenaMP is the multi-core implementation of the ATLAS software framework and allows the efficient sharing of memory pages between multiple threads of execution. This has now been validated for production and delivers a significant reduction on overall memory footprint with negligible CPU overhead. Before AthenaMP can be routinely run on the LHC Computing Grid, it must be determined how the computing resources available to ATLAS can best exploit the notable improvements delivered by switching to this multi-process model. In particular, there is a need to identify and assess the potential impact of scheduling issues where single core and multi-core job queues have access to the same underlying resources. A study into the effectiveness and scalability of AthenaMP in a production environment will be presented. Submitting AthenaMP tasks to the Tier-0 and candidate Tier-2 sites will allow detailed measurement of worker node performance and also highlight the relative performance of local resource management systems (LRMS) in handling large volumes of multi-core jobs. Best practices for configuring the main LRMS implementations currently used by Tier-2 sites will be identified in the context of multi-core job optimisation. There will also be a discussion on how existing Grid middleware and the ATLAS job submission pilot model could use scheduling information to increase the overall efficiency of multi-core job throughput.ATL-SOFT-PROC-2012-029oai:cds.cern.ch:14490842012-05-16
spellingShingle Detectors and Experimental Techniques
Crooks, D
Calafiura, P
Harrington, R
Purdie, S
Severini, H
Skipsey, S
Tsulaia, V
Washbrook, A
Multi-core job submission and grid resource scheduling for ATLAS AthenaMP
title Multi-core job submission and grid resource scheduling for ATLAS AthenaMP
title_full Multi-core job submission and grid resource scheduling for ATLAS AthenaMP
title_fullStr Multi-core job submission and grid resource scheduling for ATLAS AthenaMP
title_full_unstemmed Multi-core job submission and grid resource scheduling for ATLAS AthenaMP
title_short Multi-core job submission and grid resource scheduling for ATLAS AthenaMP
title_sort multi-core job submission and grid resource scheduling for atlas athenamp
topic Detectors and Experimental Techniques
url https://dx.doi.org/10.1088/1742-6596/396/3/032115
http://cds.cern.ch/record/1449084
work_keys_str_mv AT crooksd multicorejobsubmissionandgridresourceschedulingforatlasathenamp
AT calafiurap multicorejobsubmissionandgridresourceschedulingforatlasathenamp
AT harringtonr multicorejobsubmissionandgridresourceschedulingforatlasathenamp
AT purdies multicorejobsubmissionandgridresourceschedulingforatlasathenamp
AT severinih multicorejobsubmissionandgridresourceschedulingforatlasathenamp
AT skipseys multicorejobsubmissionandgridresourceschedulingforatlasathenamp
AT tsulaiav multicorejobsubmissionandgridresourceschedulingforatlasathenamp
AT washbrooka multicorejobsubmissionandgridresourceschedulingforatlasathenamp