Cargando…
Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool
CMS production and analysis job submission is based largely on glideinWMS and pilot submissions. The transition from multiple different submission solutions like gLite WMS and HTCondor-based implementations was carried out over years and is coming now to a conclusion. The historically explained sepa...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2013
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1622169 |
_version_ | 1780933222494896128 |
---|---|
author | Gutsche, Oliver |
author_facet | Gutsche, Oliver |
author_sort | Gutsche, Oliver |
collection | CERN |
description | CMS production and analysis job submission is based largely on glideinWMS and pilot submissions. The transition from multiple different submission solutions like gLite WMS and HTCondor-based implementations was carried out over years and is coming now to a conclusion. The historically explained separate glideinWMS pools for different types of production jobs and analysis jobs are being unified into a single global pool. This enables CMS to benefit from global prioritization and scheduling possibilities. It also presents the sites with only one kind of pilots and eliminates the need of having to make scheduling decisions on the CE level. This paper provides an analysis of the benefits of a unified resource pool, as well as a description of the resulting global policy. It will explain the technical challenges moving forward and present solutions to some of them. |
id | cern-1622169 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2013 |
record_format | invenio |
spelling | cern-16221692019-09-30T06:29:59Zhttp://cds.cern.ch/record/1622169engGutsche, OliverEvolution of the pilot infrastructure of CMS towards a single glideinWMS poolDetectors and Experimental TechniquesCMS production and analysis job submission is based largely on glideinWMS and pilot submissions. The transition from multiple different submission solutions like gLite WMS and HTCondor-based implementations was carried out over years and is coming now to a conclusion. The historically explained separate glideinWMS pools for different types of production jobs and analysis jobs are being unified into a single global pool. This enables CMS to benefit from global prioritization and scheduling possibilities. It also presents the sites with only one kind of pilots and eliminates the need of having to make scheduling decisions on the CE level. This paper provides an analysis of the benefits of a unified resource pool, as well as a description of the resulting global policy. It will explain the technical challenges moving forward and present solutions to some of them.CMS-CR-2013-360oai:cds.cern.ch:16221692013-10-28 |
spellingShingle | Detectors and Experimental Techniques Gutsche, Oliver Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool |
title | Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool |
title_full | Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool |
title_fullStr | Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool |
title_full_unstemmed | Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool |
title_short | Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool |
title_sort | evolution of the pilot infrastructure of cms towards a single glideinwms pool |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/1622169 |
work_keys_str_mv | AT gutscheoliver evolutionofthepilotinfrastructureofcmstowardsasingleglideinwmspool |