Cargando…
CMS Multicore Scheduling Strategy
In the next years, processor architectures based on much larger numbers of cores will be most likely the model to continue Moores Law style throughput gains. This not only results in many more jobs in parallel running the LHC Run 1 era monolithic applications. Also the memory requirements of these p...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2013
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/513/3/032074 http://cds.cern.ch/record/1623357 |
_version_ | 1780933385292611584 |
---|---|
author | Perez-Calero Yzquierdo, Antonio |
author_facet | Perez-Calero Yzquierdo, Antonio |
author_sort | Perez-Calero Yzquierdo, Antonio |
collection | CERN |
description | In the next years, processor architectures based on much larger numbers of cores will be most likely the model to continue Moores Law style throughput gains. This not only results in many more jobs in parallel running the LHC Run 1 era monolithic applications. Also the memory requirements of these processes push the workernode architectures to the limit. One solution is parallelizing the application itself, through forking and memory sharing or through threaded frameworks. CMS is following all of these approaches and has a comprehensive strategy to schedule multi-core jobs on the GRID based on the glideIn WMS submission infrastructure. We will present the individual components of the strategy, from special site specific queues used during provisioning of resources and implications to scheduling; to dynamic partitioning within a single pilot to allow to transition to multi-core or whole-node scheduling on site level without disallowing single-core jobs. In this presentation, we will present the experiences made with the multi-core scheduling modes and give an outlook of further developments working towards the restart of the LHC in 2015. |
id | cern-1623357 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2013 |
record_format | invenio |
spelling | cern-16233572019-09-30T06:29:59Zdoi:10.1088/1742-6596/513/3/032074http://cds.cern.ch/record/1623357engPerez-Calero Yzquierdo, Antonio CMS Multicore Scheduling StrategyDetectors and Experimental TechniquesIn the next years, processor architectures based on much larger numbers of cores will be most likely the model to continue Moores Law style throughput gains. This not only results in many more jobs in parallel running the LHC Run 1 era monolithic applications. Also the memory requirements of these processes push the workernode architectures to the limit. One solution is parallelizing the application itself, through forking and memory sharing or through threaded frameworks. CMS is following all of these approaches and has a comprehensive strategy to schedule multi-core jobs on the GRID based on the glideIn WMS submission infrastructure. We will present the individual components of the strategy, from special site specific queues used during provisioning of resources and implications to scheduling; to dynamic partitioning within a single pilot to allow to transition to multi-core or whole-node scheduling on site level without disallowing single-core jobs. In this presentation, we will present the experiences made with the multi-core scheduling modes and give an outlook of further developments working towards the restart of the LHC in 2015.CMS-CR-2013-387oai:cds.cern.ch:16233572013-10-31 |
spellingShingle | Detectors and Experimental Techniques Perez-Calero Yzquierdo, Antonio CMS Multicore Scheduling Strategy |
title | CMS Multicore Scheduling Strategy |
title_full | CMS Multicore Scheduling Strategy |
title_fullStr | CMS Multicore Scheduling Strategy |
title_full_unstemmed | CMS Multicore Scheduling Strategy |
title_short | CMS Multicore Scheduling Strategy |
title_sort | cms multicore scheduling strategy |
topic | Detectors and Experimental Techniques |
url | https://dx.doi.org/10.1088/1742-6596/513/3/032074 http://cds.cern.ch/record/1623357 |
work_keys_str_mv | AT perezcaleroyzquierdoantonio cmsmulticoreschedulingstrategy |