Cargando…

Remote data access in computational jobs on the ATLAS data grid

This work describes the technique of remote data access from computational jobs on the ATLAS data grid. In comparison to traditional data movement and stage-in approaches it is well suited for data transfers which are asynchronous with respect to the job execution. Hence, it can be used for optimiza...

Descripción completa

Detalles Bibliográficos
Autores principales: Begy, Volodimir, Barisits, Martin-Stefan, Lassnig, Mario, Schikuta, Erich
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921404028
http://cds.cern.ch/record/2645106
_version_ 1780960427251859456
author Begy, Volodimir
Barisits, Martin-Stefan
Lassnig, Mario
Schikuta, Erich
author_facet Begy, Volodimir
Barisits, Martin-Stefan
Lassnig, Mario
Schikuta, Erich
author_sort Begy, Volodimir
collection CERN
description This work describes the technique of remote data access from computational jobs on the ATLAS data grid. In comparison to traditional data movement and stage-in approaches it is well suited for data transfers which are asynchronous with respect to the job execution. Hence, it can be used for optimization of data access patterns based on various policies. In this study, remote data access is realized with the HTTP and WebDAV protocols, and is investigated in the context of intra- and inter-computing site data transfers. In both cases, the typical scenarios for application of remote data access are identified. The paper also presents an analysis of parameters influencing the data goodput between heterogeneous storage element - worker node pairs on the grid.
id cern-2645106
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26451062022-08-10T12:24:37Zdoi:10.1051/epjconf/201921404028http://cds.cern.ch/record/2645106engBegy, VolodimirBarisits, Martin-StefanLassnig, MarioSchikuta, ErichRemote data access in computational jobs on the ATLAS data gridParticle Physics - ExperimentThis work describes the technique of remote data access from computational jobs on the ATLAS data grid. In comparison to traditional data movement and stage-in approaches it is well suited for data transfers which are asynchronous with respect to the job execution. Hence, it can be used for optimization of data access patterns based on various policies. In this study, remote data access is realized with the HTTP and WebDAV protocols, and is investigated in the context of intra- and inter-computing site data transfers. In both cases, the typical scenarios for application of remote data access are identified. The paper also presents an analysis of parameters influencing the data goodput between heterogeneous storage element - worker node pairs on the grid.ATL-SOFT-PROC-2018-013oai:cds.cern.ch:26451062018-10-27
spellingShingle Particle Physics - Experiment
Begy, Volodimir
Barisits, Martin-Stefan
Lassnig, Mario
Schikuta, Erich
Remote data access in computational jobs on the ATLAS data grid
title Remote data access in computational jobs on the ATLAS data grid
title_full Remote data access in computational jobs on the ATLAS data grid
title_fullStr Remote data access in computational jobs on the ATLAS data grid
title_full_unstemmed Remote data access in computational jobs on the ATLAS data grid
title_short Remote data access in computational jobs on the ATLAS data grid
title_sort remote data access in computational jobs on the atlas data grid
topic Particle Physics - Experiment
url https://dx.doi.org/10.1051/epjconf/201921404028
http://cds.cern.ch/record/2645106
work_keys_str_mv AT begyvolodimir remotedataaccessincomputationaljobsontheatlasdatagrid
AT barisitsmartinstefan remotedataaccessincomputationaljobsontheatlasdatagrid
AT lassnigmario remotedataaccessincomputationaljobsontheatlasdatagrid
AT schikutaerich remotedataaccessincomputationaljobsontheatlasdatagrid