Modelling Large-Scale Scientific Data Transfers

This work focuses on the study of a recently published dataset (Bogado et al. in ATLAS Rucio transfers dataset. Zenodo, 2020.) with data that allow us to reconstruct the lifetime of file transfers in the contexts of the Worldwide LHC Computing Grid (WLCG). Several models for Rule Time To Complete (T...

Descripción completa

Detalles Bibliográficos
Autores principales: Bogado, Joaquin, Lassnig, Mario, Monticelli, Fernando, Díaz, Javier
Lenguaje:eng
Publicado: 2022
Materias:
Computing and Computers
Acceso en línea:https://dx.doi.org/10.1007/s41781-022-00084-4
http://cds.cern.ch/record/2816477
_version_ 1780973592758976512
author Bogado, Joaquin
Lassnig, Mario
Monticelli, Fernando
Díaz, Javier
author_facet Bogado, Joaquin
Lassnig, Mario
Monticelli, Fernando
Díaz, Javier
author_sort Bogado, Joaquin
collection CERN
description This work focuses on the study of a recently published dataset (Bogado et al. in ATLAS Rucio transfers dataset. Zenodo, 2020.) with data that allow us to reconstruct the lifetime of file transfers in the contexts of the Worldwide LHC Computing Grid (WLCG). Several models for Rule Time To Complete (TTC) prediction are presented and evaluated. The dataset source is Rucio, an open-source software framework that provides scientific collaborations with the functionality to organize, manage, and access their data at scale. The rich amount of data gathered about the transfers and rules, presents a unique opportunity to better understand the complex mechanisms involved in file transfers across the WLCG.
id cern-2816477
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2022
record_format invenio
spelling cern-28164772023-03-31T07:40:40Zdoi:10.1007/s41781-022-00084-4http://cds.cern.ch/record/2816477engBogado, JoaquinLassnig, MarioMonticelli, FernandoDíaz, JavierModelling Large-Scale Scientific Data TransfersComputing and ComputersThis work focuses on the study of a recently published dataset (Bogado et al. in ATLAS Rucio transfers dataset. Zenodo, 2020.) with data that allow us to reconstruct the lifetime of file transfers in the contexts of the Worldwide LHC Computing Grid (WLCG). Several models for Rule Time To Complete (TTC) prediction are presented and evaluated. The dataset source is Rucio, an open-source software framework that provides scientific collaborations with the functionality to organize, manage, and access their data at scale. The rich amount of data gathered about the transfers and rules, presents a unique opportunity to better understand the complex mechanisms involved in file transfers across the WLCG.oai:cds.cern.ch:28164772022
spellingShingle Computing and Computers
Bogado, Joaquin
Lassnig, Mario
Monticelli, Fernando
Díaz, Javier
Modelling Large-Scale Scientific Data Transfers
title Modelling Large-Scale Scientific Data Transfers
title_full Modelling Large-Scale Scientific Data Transfers
title_fullStr Modelling Large-Scale Scientific Data Transfers
title_full_unstemmed Modelling Large-Scale Scientific Data Transfers
title_short Modelling Large-Scale Scientific Data Transfers
title_sort modelling large-scale scientific data transfers
topic Computing and Computers
url https://dx.doi.org/10.1007/s41781-022-00084-4
http://cds.cern.ch/record/2816477
work_keys_str_mv AT bogadojoaquin modellinglargescalescientificdatatransfers
AT lassnigmario modellinglargescalescientificdatatransfers
AT monticellifernando modellinglargescalescientificdatatransfers
AT diazjavier modellinglargescalescientificdatatransfers

Ejemplares similares