Cargando…
Federating Distributed Storage For Clouds In ATLAS
Input data for applications that run in cloud computing centres can be stored at distant repositories, often with multiple copies of the popular data stored at many sites. Locating and retrieving the remote data can be challenging, and we believe that federating the storage can address this problem....
Autores principales: | , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2017
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2279110 |
_version_ | 1780955411261685760 |
---|---|
author | Berghaus, Frank Casteels, Kevin Di Girolamo, Alessandro Ebert, Marcus Furano, Fabrizio Fernandez Galindo, Fernando Lassnig, Mario Leavett-brown, Colin Roy Paterson, Michael Serfon, Cedric Seuster, Rolf Sobie, Randall Tafirout, Reda Taylor, Ryan P. |
author_facet | Berghaus, Frank Casteels, Kevin Di Girolamo, Alessandro Ebert, Marcus Furano, Fabrizio Fernandez Galindo, Fernando Lassnig, Mario Leavett-brown, Colin Roy Paterson, Michael Serfon, Cedric Seuster, Rolf Sobie, Randall Tafirout, Reda Taylor, Ryan P. |
author_sort | Berghaus, Frank |
collection | CERN |
description | Input data for applications that run in cloud computing centres can be stored at distant repositories, often with multiple copies of the popular data stored at many sites. Locating and retrieving the remote data can be challenging, and we believe that federating the storage can address this problem. A federation would locate the closest copy of the data currently on the basis of GeoIP information. Currently we are using the DynaFed data federation software solution developed by CERN IT. DynaFed supports several industry standards for connection protocols like Amazon's S3, Microsofts Azure, as well as WebDav and HTTP. Protocol dependent authentication is hidden from the user by using their X509 certificate. We have setup an instance of DynaFed and integrated it into the ATLAS Data Distribution Management system. We report on the challenges faced during the installation and integration. We have tested ATLAS analysis jobs submitted by the PanDA production system and we report on our first experiences with its operation. |
id | cern-2279110 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2017 |
record_format | invenio |
spelling | cern-22791102019-09-30T06:29:59Zhttp://cds.cern.ch/record/2279110engBerghaus, FrankCasteels, KevinDi Girolamo, AlessandroEbert, MarcusFurano, FabrizioFernandez Galindo, FernandoLassnig, MarioLeavett-brown, Colin RoyPaterson, MichaelSerfon, CedricSeuster, RolfSobie, RandallTafirout, RedaTaylor, Ryan P.Federating Distributed Storage For Clouds In ATLASParticle Physics - ExperimentInput data for applications that run in cloud computing centres can be stored at distant repositories, often with multiple copies of the popular data stored at many sites. Locating and retrieving the remote data can be challenging, and we believe that federating the storage can address this problem. A federation would locate the closest copy of the data currently on the basis of GeoIP information. Currently we are using the DynaFed data federation software solution developed by CERN IT. DynaFed supports several industry standards for connection protocols like Amazon's S3, Microsofts Azure, as well as WebDav and HTTP. Protocol dependent authentication is hidden from the user by using their X509 certificate. We have setup an instance of DynaFed and integrated it into the ATLAS Data Distribution Management system. We report on the challenges faced during the installation and integration. We have tested ATLAS analysis jobs submitted by the PanDA production system and we report on our first experiences with its operation.ATL-SOFT-SLIDE-2017-661oai:cds.cern.ch:22791102017-08-15 |
spellingShingle | Particle Physics - Experiment Berghaus, Frank Casteels, Kevin Di Girolamo, Alessandro Ebert, Marcus Furano, Fabrizio Fernandez Galindo, Fernando Lassnig, Mario Leavett-brown, Colin Roy Paterson, Michael Serfon, Cedric Seuster, Rolf Sobie, Randall Tafirout, Reda Taylor, Ryan P. Federating Distributed Storage For Clouds In ATLAS |
title | Federating Distributed Storage For Clouds In ATLAS |
title_full | Federating Distributed Storage For Clouds In ATLAS |
title_fullStr | Federating Distributed Storage For Clouds In ATLAS |
title_full_unstemmed | Federating Distributed Storage For Clouds In ATLAS |
title_short | Federating Distributed Storage For Clouds In ATLAS |
title_sort | federating distributed storage for clouds in atlas |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2279110 |
work_keys_str_mv | AT berghausfrank federatingdistributedstorageforcloudsinatlas AT casteelskevin federatingdistributedstorageforcloudsinatlas AT digirolamoalessandro federatingdistributedstorageforcloudsinatlas AT ebertmarcus federatingdistributedstorageforcloudsinatlas AT furanofabrizio federatingdistributedstorageforcloudsinatlas AT fernandezgalindofernando federatingdistributedstorageforcloudsinatlas AT lassnigmario federatingdistributedstorageforcloudsinatlas AT leavettbrowncolinroy federatingdistributedstorageforcloudsinatlas AT patersonmichael federatingdistributedstorageforcloudsinatlas AT serfoncedric federatingdistributedstorageforcloudsinatlas AT seusterrolf federatingdistributedstorageforcloudsinatlas AT sobierandall federatingdistributedstorageforcloudsinatlas AT tafiroutreda federatingdistributedstorageforcloudsinatlas AT taylorryanp federatingdistributedstorageforcloudsinatlas |