Cargando…

Matchmaking, datasets and physics analysis

Grid enabled physics analysis requires a workload management system (WMS) that takes care of finding suitable computing resources to execute data intensive jobs. A typical example is the WMS available in the LCG2 (also referred to as EGEE-0) software system, used by several scientific experiments. L...

Descripción completa

Detalles Bibliográficos
Autores principales: Donno, Flavia, Stockinger, Heinz, Eulisse, Giulio, Mazzucato, Mirco, Steenberg, Conrad
Lenguaje:eng
Publicado: 2005
Materias:
Acceso en línea:https://dx.doi.org/10.1109/ICPPW.2005.48
http://cds.cern.ch/record/1126166
_version_ 1780914859610734592
author Donno, Flavia
Stockinger, Heinz
Eulisse, Giulio
Mazzucato, Mirco
Steenberg, Conrad
author_facet Donno, Flavia
Stockinger, Heinz
Eulisse, Giulio
Mazzucato, Mirco
Steenberg, Conrad
author_sort Donno, Flavia
collection CERN
description Grid enabled physics analysis requires a workload management system (WMS) that takes care of finding suitable computing resources to execute data intensive jobs. A typical example is the WMS available in the LCG2 (also referred to as EGEE-0) software system, used by several scientific experiments. Like many other current grid systems, LCG2 provides a file level granularity for accessing and analysing data. However, application scientists such as high energy physicists often require a higher abstraction level for accessing data, i.e. they prefer to use datasets rather than files in their physics analysis. We have improved the current WMS (in particular the Matchmaker) to allow physicists to express their analysis job requirements in terms of datasets. This required modifications to the WMS and its interface to potential data catalogues. As a result, we propose a simple data location interface that is based on a Web service approach and allows for interoperability of the WMS with new dataset and file catalogues. We took a particular high energy physics experiment as the source for our study and show that physics analysis can be improved by our modifications to the current grid system.
id cern-1126166
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2005
record_format invenio
spelling cern-11261662019-09-30T06:29:59Zdoi:10.1109/ICPPW.2005.48http://cds.cern.ch/record/1126166engDonno, FlaviaStockinger, HeinzEulisse, GiulioMazzucato, MircoSteenberg, ConradMatchmaking, datasets and physics analysisComputing and ComputersGrid enabled physics analysis requires a workload management system (WMS) that takes care of finding suitable computing resources to execute data intensive jobs. A typical example is the WMS available in the LCG2 (also referred to as EGEE-0) software system, used by several scientific experiments. Like many other current grid systems, LCG2 provides a file level granularity for accessing and analysing data. However, application scientists such as high energy physicists often require a higher abstraction level for accessing data, i.e. they prefer to use datasets rather than files in their physics analysis. We have improved the current WMS (in particular the Matchmaker) to allow physicists to express their analysis job requirements in terms of datasets. This required modifications to the WMS and its interface to potential data catalogues. As a result, we propose a simple data location interface that is based on a Web service approach and allows for interoperability of the WMS with new dataset and file catalogues. We took a particular high energy physics experiment as the source for our study and show that physics analysis can be improved by our modifications to the current grid system.CERN-IT-Note-2008-014oai:cds.cern.ch:11261662005-03-01
spellingShingle Computing and Computers
Donno, Flavia
Stockinger, Heinz
Eulisse, Giulio
Mazzucato, Mirco
Steenberg, Conrad
Matchmaking, datasets and physics analysis
title Matchmaking, datasets and physics analysis
title_full Matchmaking, datasets and physics analysis
title_fullStr Matchmaking, datasets and physics analysis
title_full_unstemmed Matchmaking, datasets and physics analysis
title_short Matchmaking, datasets and physics analysis
title_sort matchmaking, datasets and physics analysis
topic Computing and Computers
url https://dx.doi.org/10.1109/ICPPW.2005.48
http://cds.cern.ch/record/1126166
work_keys_str_mv AT donnoflavia matchmakingdatasetsandphysicsanalysis
AT stockingerheinz matchmakingdatasetsandphysicsanalysis
AT eulissegiulio matchmakingdatasetsandphysicsanalysis
AT mazzucatomirco matchmakingdatasetsandphysicsanalysis
AT steenbergconrad matchmakingdatasetsandphysicsanalysis