Cargando…

Scalability tests of R-GMA based Grid job monitoring system for CMS Monte Carlo data production

High Energy Physics experiments such as CMS (Compact Muon Solenoid) at the Large Hadron Collider have unprecedented, large-scale data processing computing requirements, with data accumulating at around 1 Gbyte/s. The Grid distributed computing paradigm has been chosen as the solution to provide the...

Descripción completa

Detalles Bibliográficos
Autores principales: Bonacorsi, D, Colling, D J, Field, L, Fisher, S, Grandi, C, Hobson, P R, Kyberd, P, MacEvoy, B, Nebrensky, J J, Tallini, H, Traylen, S
Lenguaje:eng
Publicado: 2004
Materias:
Acceso en línea:http://cds.cern.ch/record/818434
_version_ 1780905473753481216
author Bonacorsi, D
Colling, D J
Field, L
Fisher, S
Grandi, C
Hobson, P R
Kyberd, P
MacEvoy, B
Nebrensky, J J
Tallini, H
Traylen, S
author_facet Bonacorsi, D
Colling, D J
Field, L
Fisher, S
Grandi, C
Hobson, P R
Kyberd, P
MacEvoy, B
Nebrensky, J J
Tallini, H
Traylen, S
author_sort Bonacorsi, D
collection CERN
description High Energy Physics experiments such as CMS (Compact Muon Solenoid) at the Large Hadron Collider have unprecedented, large-scale data processing computing requirements, with data accumulating at around 1 Gbyte/s. The Grid distributed computing paradigm has been chosen as the solution to provide the requisite computing power. The demanding nature of CMS software and computing requirements, such as the production of large quantities of Monte Carlo simulated data, makes them an ideal test case for the Grid and a major driver for the development of Grid technologies. One important challenge when using the Grid for large-scale data analysis is the ability to monitor the large numbers of jobs that are being executed simultaneously at multiple remote sites. R-GMA is a monitoring and information management service for distributed resources based on the Grid Monitoring Architecture of the Global Grid Forum. In this paper we report on the first measurements of R-GMA as part of a monitoring architecture to be used for batch submission of multiple CMS Monte Carlo simulation jobs running on the CMS-LCGO Grid test-bed. Monitoring information was transferred in real time from remote executing nodes back to the submitting host and stored in a database. Scalability tests were undertaken whereby the job submission rate was ramped up to rates comparable with those expected in a full-scale production. (6 refs).
id cern-818434
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2004
record_format invenio
spelling cern-8184342019-09-30T06:29:59Zhttp://cds.cern.ch/record/818434engBonacorsi, DColling, D JField, LFisher, SGrandi, CHobson, P RKyberd, PMacEvoy, BNebrensky, J JTallini, HTraylen, SScalability tests of R-GMA based Grid job monitoring system for CMS Monte Carlo data productionComputing and ComputersHigh Energy Physics experiments such as CMS (Compact Muon Solenoid) at the Large Hadron Collider have unprecedented, large-scale data processing computing requirements, with data accumulating at around 1 Gbyte/s. The Grid distributed computing paradigm has been chosen as the solution to provide the requisite computing power. The demanding nature of CMS software and computing requirements, such as the production of large quantities of Monte Carlo simulated data, makes them an ideal test case for the Grid and a major driver for the development of Grid technologies. One important challenge when using the Grid for large-scale data analysis is the ability to monitor the large numbers of jobs that are being executed simultaneously at multiple remote sites. R-GMA is a monitoring and information management service for distributed resources based on the Grid Monitoring Architecture of the Global Grid Forum. In this paper we report on the first measurements of R-GMA as part of a monitoring architecture to be used for batch submission of multiple CMS Monte Carlo simulation jobs running on the CMS-LCGO Grid test-bed. Monitoring information was transferred in real time from remote executing nodes back to the submitting host and stored in a database. Scalability tests were undertaken whereby the job submission rate was ramped up to rates comparable with those expected in a full-scale production. (6 refs).oai:cds.cern.ch:8184342004
spellingShingle Computing and Computers
Bonacorsi, D
Colling, D J
Field, L
Fisher, S
Grandi, C
Hobson, P R
Kyberd, P
MacEvoy, B
Nebrensky, J J
Tallini, H
Traylen, S
Scalability tests of R-GMA based Grid job monitoring system for CMS Monte Carlo data production
title Scalability tests of R-GMA based Grid job monitoring system for CMS Monte Carlo data production
title_full Scalability tests of R-GMA based Grid job monitoring system for CMS Monte Carlo data production
title_fullStr Scalability tests of R-GMA based Grid job monitoring system for CMS Monte Carlo data production
title_full_unstemmed Scalability tests of R-GMA based Grid job monitoring system for CMS Monte Carlo data production
title_short Scalability tests of R-GMA based Grid job monitoring system for CMS Monte Carlo data production
title_sort scalability tests of r-gma based grid job monitoring system for cms monte carlo data production
topic Computing and Computers
url http://cds.cern.ch/record/818434
work_keys_str_mv AT bonacorsid scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT collingdj scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT fieldl scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT fishers scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT grandic scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT hobsonpr scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT kyberdp scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT macevoyb scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT nebrenskyjj scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT tallinih scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction
AT traylens scalabilitytestsofrgmabasedgridjobmonitoringsystemforcmsmontecarlodataproduction