Cargando…
Remote data access in computational jobs on the ATLAS data grid
This work describes the technique of remote data access from computational jobs on the ATLAS data grid. In comparison to traditional data movement and stage-in approaches it is well suited for data transfers which are asynchronous with respect to the job execution. Hence, it can be used for optimiza...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2018
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/201921404028 http://cds.cern.ch/record/2645106 |
_version_ | 1780960427251859456 |
---|---|
author | Begy, Volodimir Barisits, Martin-Stefan Lassnig, Mario Schikuta, Erich |
author_facet | Begy, Volodimir Barisits, Martin-Stefan Lassnig, Mario Schikuta, Erich |
author_sort | Begy, Volodimir |
collection | CERN |
description | This work describes the technique of remote data access from computational jobs on the ATLAS data grid. In comparison to traditional data movement and stage-in approaches it is well suited for data transfers which are asynchronous with respect to the job execution. Hence, it can be used for optimization of data access patterns based on various policies. In this study, remote data access is realized with the HTTP and WebDAV protocols, and is investigated in the context of intra- and inter-computing site data transfers. In both cases, the typical scenarios for application of remote data access are identified. The paper also presents an analysis of parameters influencing the data goodput between heterogeneous storage element - worker node pairs on the grid. |
id | cern-2645106 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2018 |
record_format | invenio |
spelling | cern-26451062022-08-10T12:24:37Zdoi:10.1051/epjconf/201921404028http://cds.cern.ch/record/2645106engBegy, VolodimirBarisits, Martin-StefanLassnig, MarioSchikuta, ErichRemote data access in computational jobs on the ATLAS data gridParticle Physics - ExperimentThis work describes the technique of remote data access from computational jobs on the ATLAS data grid. In comparison to traditional data movement and stage-in approaches it is well suited for data transfers which are asynchronous with respect to the job execution. Hence, it can be used for optimization of data access patterns based on various policies. In this study, remote data access is realized with the HTTP and WebDAV protocols, and is investigated in the context of intra- and inter-computing site data transfers. In both cases, the typical scenarios for application of remote data access are identified. The paper also presents an analysis of parameters influencing the data goodput between heterogeneous storage element - worker node pairs on the grid.ATL-SOFT-PROC-2018-013oai:cds.cern.ch:26451062018-10-27 |
spellingShingle | Particle Physics - Experiment Begy, Volodimir Barisits, Martin-Stefan Lassnig, Mario Schikuta, Erich Remote data access in computational jobs on the ATLAS data grid |
title | Remote data access in computational jobs on the ATLAS data grid |
title_full | Remote data access in computational jobs on the ATLAS data grid |
title_fullStr | Remote data access in computational jobs on the ATLAS data grid |
title_full_unstemmed | Remote data access in computational jobs on the ATLAS data grid |
title_short | Remote data access in computational jobs on the ATLAS data grid |
title_sort | remote data access in computational jobs on the atlas data grid |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1051/epjconf/201921404028 http://cds.cern.ch/record/2645106 |
work_keys_str_mv | AT begyvolodimir remotedataaccessincomputationaljobsontheatlasdatagrid AT barisitsmartinstefan remotedataaccessincomputationaljobsontheatlasdatagrid AT lassnigmario remotedataaccessincomputationaljobsontheatlasdatagrid AT schikutaerich remotedataaccessincomputationaljobsontheatlasdatagrid |