Cargando…
Implementation and performances of a DPM federated storage and integration within the ATLAS environment
The increase of storage usage at the HL-LHC horizon will induce scalability challenges on the data management tools and storage operation by site administrators. The evaluation of possible solutions for storage and their access within the DOMA, DOMA-FR (IN2P3 project contribution to DOMA) and ESCAPE...
Autores principales: | , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2019
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2697089 |
_version_ | 1780964200058716160 |
---|---|
author | Jezequel, Stephane Crepe-Renaudin, Sabine Chrystel Adam Bourdarios, Claire Le Flour Chollet, Frederique Marie Knoops, Edith B F G Chevaleyre, Jean-Claude Gougerot, Murielle Anne Lise Gondrand, Christine Nicole |
author_facet | Jezequel, Stephane Crepe-Renaudin, Sabine Chrystel Adam Bourdarios, Claire Le Flour Chollet, Frederique Marie Knoops, Edith B F G Chevaleyre, Jean-Claude Gougerot, Murielle Anne Lise Gondrand, Christine Nicole |
author_sort | Jezequel, Stephane |
collection | CERN |
description | The increase of storage usage at the HL-LHC horizon will induce scalability challenges on the data management tools and storage operation by site administrators. The evaluation of possible solutions for storage and their access within the DOMA, DOMA-FR (IN2P3 project contribution to DOMA) and ESCAPE initiatives is a major activity to select the most optimal ones from the experiment and site point of views. The LAPP and LPSC teams have put their expertise and computing infrastructures together to build the FR-ALPES federation and set up a DPM federated storage. Based on their experience of Tier2 WLCG site management, their implication in the ATLAS Grid infrastructure and thanks to the flexibility of ATLAS and Rucio tools, the integration of this federation into the ATLAS Grid infrastructure has been straightforward. In addition, the integrated DPM caching mechanism including volatile pools is also implemented. This infrastructure is foreseen to be a testbed for a DPM component within a DataLake. This presentation will describe the testbed (infrastructures separated by few ms in Round Trip Time unit) and its integration into the ATLAS computing framework. The impact on the sites and ATLAS operations of both the testbed implementation and its use will also be shown, as well as the measured performances on data access speed and reliability. |
id | cern-2697089 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2019 |
record_format | invenio |
spelling | cern-26970892019-10-29T21:27:11Zhttp://cds.cern.ch/record/2697089engJezequel, StephaneCrepe-Renaudin, Sabine ChrystelAdam Bourdarios, ClaireLe Flour Chollet, Frederique MarieKnoops, Edith B F GChevaleyre, Jean-ClaudeGougerot, Murielle Anne LiseGondrand, Christine NicoleImplementation and performances of a DPM federated storage and integration within the ATLAS environmentParticle Physics - ExperimentThe increase of storage usage at the HL-LHC horizon will induce scalability challenges on the data management tools and storage operation by site administrators. The evaluation of possible solutions for storage and their access within the DOMA, DOMA-FR (IN2P3 project contribution to DOMA) and ESCAPE initiatives is a major activity to select the most optimal ones from the experiment and site point of views. The LAPP and LPSC teams have put their expertise and computing infrastructures together to build the FR-ALPES federation and set up a DPM federated storage. Based on their experience of Tier2 WLCG site management, their implication in the ATLAS Grid infrastructure and thanks to the flexibility of ATLAS and Rucio tools, the integration of this federation into the ATLAS Grid infrastructure has been straightforward. In addition, the integrated DPM caching mechanism including volatile pools is also implemented. This infrastructure is foreseen to be a testbed for a DPM component within a DataLake. This presentation will describe the testbed (infrastructures separated by few ms in Round Trip Time unit) and its integration into the ATLAS computing framework. The impact on the sites and ATLAS operations of both the testbed implementation and its use will also be shown, as well as the measured performances on data access speed and reliability.ATL-SOFT-SLIDE-2019-816oai:cds.cern.ch:26970892019-10-29 |
spellingShingle | Particle Physics - Experiment Jezequel, Stephane Crepe-Renaudin, Sabine Chrystel Adam Bourdarios, Claire Le Flour Chollet, Frederique Marie Knoops, Edith B F G Chevaleyre, Jean-Claude Gougerot, Murielle Anne Lise Gondrand, Christine Nicole Implementation and performances of a DPM federated storage and integration within the ATLAS environment |
title | Implementation and performances of a DPM federated storage and integration within the ATLAS environment |
title_full | Implementation and performances of a DPM federated storage and integration within the ATLAS environment |
title_fullStr | Implementation and performances of a DPM federated storage and integration within the ATLAS environment |
title_full_unstemmed | Implementation and performances of a DPM federated storage and integration within the ATLAS environment |
title_short | Implementation and performances of a DPM federated storage and integration within the ATLAS environment |
title_sort | implementation and performances of a dpm federated storage and integration within the atlas environment |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2697089 |
work_keys_str_mv | AT jezequelstephane implementationandperformancesofadpmfederatedstorageandintegrationwithintheatlasenvironment AT creperenaudinsabinechrystel implementationandperformancesofadpmfederatedstorageandintegrationwithintheatlasenvironment AT adambourdariosclaire implementationandperformancesofadpmfederatedstorageandintegrationwithintheatlasenvironment AT leflourcholletfrederiquemarie implementationandperformancesofadpmfederatedstorageandintegrationwithintheatlasenvironment AT knoopsedithbfg implementationandperformancesofadpmfederatedstorageandintegrationwithintheatlasenvironment AT chevaleyrejeanclaude implementationandperformancesofadpmfederatedstorageandintegrationwithintheatlasenvironment AT gougerotmurielleannelise implementationandperformancesofadpmfederatedstorageandintegrationwithintheatlasenvironment AT gondrandchristinenicole implementationandperformancesofadpmfederatedstorageandintegrationwithintheatlasenvironment |