Cargando…
A new era for central processing and production in CMS
The goal for CMS computing is to maximise the throughput of simulated event generation while also processing the real data events as quickly and reliably as possible. To maintain this achievement as the quantity of events increases, since the beginning of 2011 CMS computing has migrated at the Tier...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2012
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/396/4/042018 http://cds.cern.ch/record/1457469 |
_version_ | 1780925121005879296 |
---|---|
author | Fajardo Hernandez,Edgar Mauricio |
author_facet | Fajardo Hernandez,Edgar Mauricio |
author_sort | Fajardo Hernandez,Edgar Mauricio |
collection | CERN |
description | The goal for CMS computing is to maximise the throughput of simulated event generation while also processing the real data events as quickly and reliably as possible. To maintain this achievement as the quantity of events increases, since the beginning of 2011 CMS computing has migrated at the Tier 1 level from its old production framework, ProdAgent, to a new one, WMAgent. The WMAgent framework offers improved processing efficiency and increased resource usage as well as a reduction in manpower.
In addition to the challenges encountered during the design of the WMAgent framework, several operational issues have arisen during its commissioning. The largest operational challenges were in the usage and monitoring of resources, mainly a result of a change in the way work is allocated. Instead of work being assigned to operators, all work is centrally injected and managed in the Request Manager system and the task of the operators has changed from running individual workflows to monitoring the global workload.
In this report we present how we tackled some of the operational challenges, and how we benefitted from the lessons learned in the commissioning of the WMAgent framework at the Tier 2 level in late 2011. As case studies, we will show how the WMAgent system performed during some of the large data reprocessing and Monte Carlo simulation campaigns. |
id | cern-1457469 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2012 |
record_format | invenio |
spelling | cern-14574692019-09-30T06:29:59Zdoi:10.1088/1742-6596/396/4/042018http://cds.cern.ch/record/1457469engFajardo Hernandez,Edgar MauricioA new era for central processing and production in CMSDetectors and Experimental TechniquesThe goal for CMS computing is to maximise the throughput of simulated event generation while also processing the real data events as quickly and reliably as possible. To maintain this achievement as the quantity of events increases, since the beginning of 2011 CMS computing has migrated at the Tier 1 level from its old production framework, ProdAgent, to a new one, WMAgent. The WMAgent framework offers improved processing efficiency and increased resource usage as well as a reduction in manpower. In addition to the challenges encountered during the design of the WMAgent framework, several operational issues have arisen during its commissioning. The largest operational challenges were in the usage and monitoring of resources, mainly a result of a change in the way work is allocated. Instead of work being assigned to operators, all work is centrally injected and managed in the Request Manager system and the task of the operators has changed from running individual workflows to monitoring the global workload. In this report we present how we tackled some of the operational challenges, and how we benefitted from the lessons learned in the commissioning of the WMAgent framework at the Tier 2 level in late 2011. As case studies, we will show how the WMAgent system performed during some of the large data reprocessing and Monte Carlo simulation campaigns.CMS-CR-2012-070oai:cds.cern.ch:14574692012-05-10 |
spellingShingle | Detectors and Experimental Techniques Fajardo Hernandez,Edgar Mauricio A new era for central processing and production in CMS |
title | A new era for central processing and production in CMS |
title_full | A new era for central processing and production in CMS |
title_fullStr | A new era for central processing and production in CMS |
title_full_unstemmed | A new era for central processing and production in CMS |
title_short | A new era for central processing and production in CMS |
title_sort | new era for central processing and production in cms |
topic | Detectors and Experimental Techniques |
url | https://dx.doi.org/10.1088/1742-6596/396/4/042018 http://cds.cern.ch/record/1457469 |
work_keys_str_mv | AT fajardohernandezedgarmauricio aneweraforcentralprocessingandproductionincms AT fajardohernandezedgarmauricio neweraforcentralprocessingandproductionincms |