Cargando…

Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool

CMS production and analysis job submission is based largely on glideinWMS and pilot submissions. The transition from multiple different submission solutions like gLite WMS and HTCondor-based implementations was carried out over years and is coming now to a conclusion. The historically explained sepa...

Descripción completa

Detalles Bibliográficos
Autor principal: Gutsche, Oliver
Lenguaje:eng
Publicado: 2013
Materias:
Acceso en línea:http://cds.cern.ch/record/1622169
_version_ 1780933222494896128
author Gutsche, Oliver
author_facet Gutsche, Oliver
author_sort Gutsche, Oliver
collection CERN
description CMS production and analysis job submission is based largely on glideinWMS and pilot submissions. The transition from multiple different submission solutions like gLite WMS and HTCondor-based implementations was carried out over years and is coming now to a conclusion. The historically explained separate glideinWMS pools for different types of production jobs and analysis jobs are being unified into a single global pool. This enables CMS to benefit from global prioritization and scheduling possibilities. It also presents the sites with only one kind of pilots and eliminates the need of having to make scheduling decisions on the CE level. This paper provides an analysis of the benefits of a unified resource pool, as well as a description of the resulting global policy. It will explain the technical challenges moving forward and present solutions to some of them.
id cern-1622169
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2013
record_format invenio
spelling cern-16221692019-09-30T06:29:59Zhttp://cds.cern.ch/record/1622169engGutsche, OliverEvolution of the pilot infrastructure of CMS towards a single glideinWMS poolDetectors and Experimental TechniquesCMS production and analysis job submission is based largely on glideinWMS and pilot submissions. The transition from multiple different submission solutions like gLite WMS and HTCondor-based implementations was carried out over years and is coming now to a conclusion. The historically explained separate glideinWMS pools for different types of production jobs and analysis jobs are being unified into a single global pool. This enables CMS to benefit from global prioritization and scheduling possibilities. It also presents the sites with only one kind of pilots and eliminates the need of having to make scheduling decisions on the CE level. This paper provides an analysis of the benefits of a unified resource pool, as well as a description of the resulting global policy. It will explain the technical challenges moving forward and present solutions to some of them.CMS-CR-2013-360oai:cds.cern.ch:16221692013-10-28
spellingShingle Detectors and Experimental Techniques
Gutsche, Oliver
Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool
title Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool
title_full Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool
title_fullStr Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool
title_full_unstemmed Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool
title_short Evolution of the pilot infrastructure of CMS towards a single glideinWMS pool
title_sort evolution of the pilot infrastructure of cms towards a single glideinwms pool
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1622169
work_keys_str_mv AT gutscheoliver evolutionofthepilotinfrastructureofcmstowardsasingleglideinwmspool