Cargando…

CMS Multicore Scheduling Strategy

In the next years, processor architectures based on much larger numbers of cores will be most likely the model to continue Moores Law style throughput gains. This not only results in many more jobs in parallel running the LHC Run 1 era monolithic applications. Also the memory requirements of these p...

Descripción completa

Detalles Bibliográficos
Autor principal: Perez-Calero Yzquierdo, Antonio
Lenguaje:eng
Publicado: 2013
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/513/3/032074
http://cds.cern.ch/record/1623357
_version_ 1780933385292611584
author Perez-Calero Yzquierdo, Antonio
author_facet Perez-Calero Yzquierdo, Antonio
author_sort Perez-Calero Yzquierdo, Antonio
collection CERN
description In the next years, processor architectures based on much larger numbers of cores will be most likely the model to continue Moores Law style throughput gains. This not only results in many more jobs in parallel running the LHC Run 1 era monolithic applications. Also the memory requirements of these processes push the workernode architectures to the limit. One solution is parallelizing the application itself, through forking and memory sharing or through threaded frameworks. CMS is following all of these approaches and has a comprehensive strategy to schedule multi-core jobs on the GRID based on the glideIn WMS submission infrastructure. We will present the individual components of the strategy, from special site specific queues used during provisioning of resources and implications to scheduling; to dynamic partitioning within a single pilot to allow to transition to multi-core or whole-node scheduling on site level without disallowing single-core jobs. In this presentation, we will present the experiences made with the multi-core scheduling modes and give an outlook of further developments working towards the restart of the LHC in 2015.
id cern-1623357
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2013
record_format invenio
spelling cern-16233572019-09-30T06:29:59Zdoi:10.1088/1742-6596/513/3/032074http://cds.cern.ch/record/1623357engPerez-Calero Yzquierdo, Antonio CMS Multicore Scheduling StrategyDetectors and Experimental TechniquesIn the next years, processor architectures based on much larger numbers of cores will be most likely the model to continue Moores Law style throughput gains. This not only results in many more jobs in parallel running the LHC Run 1 era monolithic applications. Also the memory requirements of these processes push the workernode architectures to the limit. One solution is parallelizing the application itself, through forking and memory sharing or through threaded frameworks. CMS is following all of these approaches and has a comprehensive strategy to schedule multi-core jobs on the GRID based on the glideIn WMS submission infrastructure. We will present the individual components of the strategy, from special site specific queues used during provisioning of resources and implications to scheduling; to dynamic partitioning within a single pilot to allow to transition to multi-core or whole-node scheduling on site level without disallowing single-core jobs. In this presentation, we will present the experiences made with the multi-core scheduling modes and give an outlook of further developments working towards the restart of the LHC in 2015.CMS-CR-2013-387oai:cds.cern.ch:16233572013-10-31
spellingShingle Detectors and Experimental Techniques
Perez-Calero Yzquierdo, Antonio
CMS Multicore Scheduling Strategy
title CMS Multicore Scheduling Strategy
title_full CMS Multicore Scheduling Strategy
title_fullStr CMS Multicore Scheduling Strategy
title_full_unstemmed CMS Multicore Scheduling Strategy
title_short CMS Multicore Scheduling Strategy
title_sort cms multicore scheduling strategy
topic Detectors and Experimental Techniques
url https://dx.doi.org/10.1088/1742-6596/513/3/032074
http://cds.cern.ch/record/1623357
work_keys_str_mv AT perezcaleroyzquierdoantonio cmsmulticoreschedulingstrategy