Cargando…

A new era for central processing and production in CMS

The goal for CMS computing is to maximise the throughput of simulated event generation while also processing the real data events as quickly and reliably as possible. To maintain this achievement as the quantity of events increases, since the beginning of 2011 CMS computing has migrated at the Tier...

Descripción completa

Detalles Bibliográficos
Autor principal: Fajardo Hernandez,Edgar Mauricio
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/396/4/042018
http://cds.cern.ch/record/1457469
_version_ 1780925121005879296
author Fajardo Hernandez,Edgar Mauricio
author_facet Fajardo Hernandez,Edgar Mauricio
author_sort Fajardo Hernandez,Edgar Mauricio
collection CERN
description The goal for CMS computing is to maximise the throughput of simulated event generation while also processing the real data events as quickly and reliably as possible. To maintain this achievement as the quantity of events increases, since the beginning of 2011 CMS computing has migrated at the Tier 1 level from its old production framework, ProdAgent, to a new one, WMAgent. The WMAgent framework offers improved processing efficiency and increased resource usage as well as a reduction in manpower. In addition to the challenges encountered during the design of the WMAgent framework, several operational issues have arisen during its commissioning. The largest operational challenges were in the usage and monitoring of resources, mainly a result of a change in the way work is allocated. Instead of work being assigned to operators, all work is centrally injected and managed in the Request Manager system and the task of the operators has changed from running individual workflows to monitoring the global workload. In this report we present how we tackled some of the operational challenges, and how we benefitted from the lessons learned in the commissioning of the WMAgent framework at the Tier 2 level in late 2011. As case studies, we will show how the WMAgent system performed during some of the large data reprocessing and Monte Carlo simulation campaigns.
id cern-1457469
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14574692019-09-30T06:29:59Zdoi:10.1088/1742-6596/396/4/042018http://cds.cern.ch/record/1457469engFajardo Hernandez,Edgar MauricioA new era for central processing and production in CMSDetectors and Experimental TechniquesThe goal for CMS computing is to maximise the throughput of simulated event generation while also processing the real data events as quickly and reliably as possible. To maintain this achievement as the quantity of events increases, since the beginning of 2011 CMS computing has migrated at the Tier 1 level from its old production framework, ProdAgent, to a new one, WMAgent. The WMAgent framework offers improved processing efficiency and increased resource usage as well as a reduction in manpower. In addition to the challenges encountered during the design of the WMAgent framework, several operational issues have arisen during its commissioning. The largest operational challenges were in the usage and monitoring of resources, mainly a result of a change in the way work is allocated. Instead of work being assigned to operators, all work is centrally injected and managed in the Request Manager system and the task of the operators has changed from running individual workflows to monitoring the global workload. In this report we present how we tackled some of the operational challenges, and how we benefitted from the lessons learned in the commissioning of the WMAgent framework at the Tier 2 level in late 2011. As case studies, we will show how the WMAgent system performed during some of the large data reprocessing and Monte Carlo simulation campaigns.CMS-CR-2012-070oai:cds.cern.ch:14574692012-05-10
spellingShingle Detectors and Experimental Techniques
Fajardo Hernandez,Edgar Mauricio
A new era for central processing and production in CMS
title A new era for central processing and production in CMS
title_full A new era for central processing and production in CMS
title_fullStr A new era for central processing and production in CMS
title_full_unstemmed A new era for central processing and production in CMS
title_short A new era for central processing and production in CMS
title_sort new era for central processing and production in cms
topic Detectors and Experimental Techniques
url https://dx.doi.org/10.1088/1742-6596/396/4/042018
http://cds.cern.ch/record/1457469
work_keys_str_mv AT fajardohernandezedgarmauricio aneweraforcentralprocessingandproductionincms
AT fajardohernandezedgarmauricio neweraforcentralprocessingandproductionincms