Cargando…

Performance and impact of dynamic data placement in ATLAS

For high-throughput computing the efficient use of distributed computing resources relies on an evenly distributed workload, which in turn requires wide availability of input data that is used in physics analysis. In ATLAS, the dynamic data placement agent C3PO was implemented in the ATLAS distribut...

Descripción completa

Detalles Bibliográficos
Autores principales: Maier, Thomas, Beermann, Thomas Alfons, Duckeck, Guenter, Lassnig, Mario, Legger, Federica, Vukotic, Ilija, Magoni, Matteo
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921404025
http://cds.cern.ch/record/2644708
Descripción
Sumario:For high-throughput computing the efficient use of distributed computing resources relies on an evenly distributed workload, which in turn requires wide availability of input data that is used in physics analysis. In ATLAS, the dynamic data placement agent C3PO was implemented in the ATLAS distributed data management system Rucio which identifies popular data and creates additional, transient replicas to make data more widely and more reliably available. This proceedings presents studies on the performance of C3PO and the impact it has on throughput rates of distributed computing in ATLAS. Furthermore, results of a study on popularity prediction using machine learning techniques are presented.