Cargando…

EMI datalib: Joining the best of ARC and gLite data libraries

To manage data in the grid, with its jungle of protocols and enormous amount of data in different storage solutions, it is important to have a strong, versatile and reliable data management library. While there are several data management tools and libraries available, they all have different streng...

Descripción completa

Detalles Bibliográficos
Autores principales: Nilsen, JK, Cameron, D, Devresse, A, Molnar, Zs, Nagy, Zs, Salichos, M
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/396/5/052057
http://cds.cern.ch/record/1515978
_version_ 1780928427043323904
author Nilsen, JK
Cameron, D
Devresse, A
Molnar, Zs
Nagy, Zs
Salichos, M
author_facet Nilsen, JK
Cameron, D
Devresse, A
Molnar, Zs
Nagy, Zs
Salichos, M
author_sort Nilsen, JK
collection CERN
description To manage data in the grid, with its jungle of protocols and enormous amount of data in different storage solutions, it is important to have a strong, versatile and reliable data management library. While there are several data management tools and libraries available, they all have different strengths and weaknesses, and it can be hard to decide which tool to use for which purpose. EMI is a collaboration between the European middleware providers aiming to take the best out of each middleware to create one consolidated, all-purpose grid middleware. When EMI started there were two main tools for managing data - gLite had lcg util and the GFAL library, ARC had the ARC data tools and libarcdata2. While different in design and purpose, they both have the same goal, to manage data in the grid. The design of the new EMI datalib was ready by the end of 2011, and a first prototype is now implemented and going through a thorough testing phase. This presentation will give the latest results of the consolidated library together with an overview of the design, test plan and roadmap of EMI datalib.
id cern-1515978
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-15159782022-08-17T13:24:46Zdoi:10.1088/1742-6596/396/5/052057http://cds.cern.ch/record/1515978engNilsen, JKCameron, DDevresse, AMolnar, ZsNagy, ZsSalichos, MEMI datalib: Joining the best of ARC and gLite data librariesComputing and ComputersTo manage data in the grid, with its jungle of protocols and enormous amount of data in different storage solutions, it is important to have a strong, versatile and reliable data management library. While there are several data management tools and libraries available, they all have different strengths and weaknesses, and it can be hard to decide which tool to use for which purpose. EMI is a collaboration between the European middleware providers aiming to take the best out of each middleware to create one consolidated, all-purpose grid middleware. When EMI started there were two main tools for managing data - gLite had lcg util and the GFAL library, ARC had the ARC data tools and libarcdata2. While different in design and purpose, they both have the same goal, to manage data in the grid. The design of the new EMI datalib was ready by the end of 2011, and a first prototype is now implemented and going through a thorough testing phase. This presentation will give the latest results of the consolidated library together with an overview of the design, test plan and roadmap of EMI datalib.oai:cds.cern.ch:15159782012
spellingShingle Computing and Computers
Nilsen, JK
Cameron, D
Devresse, A
Molnar, Zs
Nagy, Zs
Salichos, M
EMI datalib: Joining the best of ARC and gLite data libraries
title EMI datalib: Joining the best of ARC and gLite data libraries
title_full EMI datalib: Joining the best of ARC and gLite data libraries
title_fullStr EMI datalib: Joining the best of ARC and gLite data libraries
title_full_unstemmed EMI datalib: Joining the best of ARC and gLite data libraries
title_short EMI datalib: Joining the best of ARC and gLite data libraries
title_sort emi datalib: joining the best of arc and glite data libraries
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/396/5/052057
http://cds.cern.ch/record/1515978
work_keys_str_mv AT nilsenjk emidatalibjoiningthebestofarcandglitedatalibraries
AT camerond emidatalibjoiningthebestofarcandglitedatalibraries
AT devressea emidatalibjoiningthebestofarcandglitedatalibraries
AT molnarzs emidatalibjoiningthebestofarcandglitedatalibraries
AT nagyzs emidatalibjoiningthebestofarcandglitedatalibraries
AT salichosm emidatalibjoiningthebestofarcandglitedatalibraries