Cargando…

Tools to use heterogeneous Grid schedulers and storage system

The Grid approach provides an uniform access to a set of geographically distributed heterogeneous resources and services, enabling projects that would be impossible without massive computing power. Different storage projects have been developed and a few protocols are being used to interact with the...

Descripción completa

Detalles Bibliográficos
Autor principal: Cinquilli, Mattia
Lenguaje:eng
Publicado: 2010
Materias:
Acceso en línea:http://cds.cern.ch/record/1285524
_version_ 1780920572172042240
author Cinquilli, Mattia
author_facet Cinquilli, Mattia
author_sort Cinquilli, Mattia
collection CERN
description The Grid approach provides an uniform access to a set of geographically distributed heterogeneous resources and services, enabling projects that would be impossible without massive computing power. Different storage projects have been developed and a few protocols are being used to interact with them such as GsiFtp and SRM (Storage Resource Manager). Moreover, during last few years different Grid projects have developed different middleware such as EGEE, OSG, NorduGrid and each one typically implements its own interface and workflow. For a user community which needs to work through the Grid, interoperability is a key concept. To handle different Grid interfaces, the resource heterogeneity and different workflows, in a really transparent way, we have developed two modular tools: BossLite and Storage Element API. These deal with different Grid schedulers and storage systems respectively, by providing a uniform standard interface that hides the differences between the systems they interact with. BossLite transparently interacts with different Grid systems, working as a layer between an application and the middleware. Storage Element API implements and manages the operations that can be performed with the different protocols used in the main Grid storage systems. Both the tools are already being used in production in the CMS computing tools for distributed analysis and Monte Carlo production. In this paper we show their implementation, how they are used and performance results.
id cern-1285524
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2010
record_format invenio
spelling cern-12855242019-09-30T06:29:59Zhttp://cds.cern.ch/record/1285524engCinquilli, MattiaTools to use heterogeneous Grid schedulers and storage systemDetectors and Experimental TechniquesThe Grid approach provides an uniform access to a set of geographically distributed heterogeneous resources and services, enabling projects that would be impossible without massive computing power. Different storage projects have been developed and a few protocols are being used to interact with them such as GsiFtp and SRM (Storage Resource Manager). Moreover, during last few years different Grid projects have developed different middleware such as EGEE, OSG, NorduGrid and each one typically implements its own interface and workflow. For a user community which needs to work through the Grid, interoperability is a key concept. To handle different Grid interfaces, the resource heterogeneity and different workflows, in a really transparent way, we have developed two modular tools: BossLite and Storage Element API. These deal with different Grid schedulers and storage systems respectively, by providing a uniform standard interface that hides the differences between the systems they interact with. BossLite transparently interacts with different Grid systems, working as a layer between an application and the middleware. Storage Element API implements and manages the operations that can be performed with the different protocols used in the main Grid storage systems. Both the tools are already being used in production in the CMS computing tools for distributed analysis and Monte Carlo production. In this paper we show their implementation, how they are used and performance results.CMS-CR-2010-048oai:cds.cern.ch:12855242010-03-31
spellingShingle Detectors and Experimental Techniques
Cinquilli, Mattia
Tools to use heterogeneous Grid schedulers and storage system
title Tools to use heterogeneous Grid schedulers and storage system
title_full Tools to use heterogeneous Grid schedulers and storage system
title_fullStr Tools to use heterogeneous Grid schedulers and storage system
title_full_unstemmed Tools to use heterogeneous Grid schedulers and storage system
title_short Tools to use heterogeneous Grid schedulers and storage system
title_sort tools to use heterogeneous grid schedulers and storage system
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1285524
work_keys_str_mv AT cinquillimattia toolstouseheterogeneousgridschedulersandstoragesystem