Cargando…
The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS
We present NOTED, a project to better exploit WAN bandwidth for Rucio and FTS data transfers. We describe the developed software tool-box and a successful demonstration of automated load-balancing in the production network. The first component is the Transfer Broker: It identifies large data transfe...
Autores principales: | , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024507022 http://cds.cern.ch/record/2752532 |
_version_ | 1780969334035709952 |
---|---|
author | Busse-Grawitz, Coralie Martelli, Edoardo Lassnig, Mario Manzi, Andrea Keeble, Oliver Cass, Tony |
author_facet | Busse-Grawitz, Coralie Martelli, Edoardo Lassnig, Mario Manzi, Andrea Keeble, Oliver Cass, Tony |
author_sort | Busse-Grawitz, Coralie |
collection | CERN |
description | We present NOTED, a project to better exploit WAN bandwidth for Rucio and FTS data transfers. We describe the developed software tool-box and a successful demonstration of automated load-balancing in the production network. The first component is the Transfer Broker: It identifies large data transfers for which network reconfiguration is both possible and beneficial, and translates the transfer information into parameters that can be used by network controllers. It will make this information available via a public interface. The second component is a demonstration of a Network Controller. It periodically reads the parameters provided by the Transfer Broker, and so decides which actions to apply to improve the network utilisation for a given transfer. |
id | oai-inspirehep.net-1832210 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | oai-inspirehep.net-18322102021-02-22T19:39:29Zdoi:10.1051/epjconf/202024507022http://cds.cern.ch/record/2752532engBusse-Grawitz, CoralieMartelli, EdoardoLassnig, MarioManzi, AndreaKeeble, OliverCass, TonyThe NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTSComputing and ComputersWe present NOTED, a project to better exploit WAN bandwidth for Rucio and FTS data transfers. We describe the developed software tool-box and a successful demonstration of automated load-balancing in the production network. The first component is the Transfer Broker: It identifies large data transfers for which network reconfiguration is both possible and beneficial, and translates the transfer information into parameters that can be used by network controllers. It will make this information available via a public interface. The second component is a demonstration of a Network Controller. It periodically reads the parameters provided by the Transfer Broker, and so decides which actions to apply to improve the network utilisation for a given transfer.oai:inspirehep.net:18322102020 |
spellingShingle | Computing and Computers Busse-Grawitz, Coralie Martelli, Edoardo Lassnig, Mario Manzi, Andrea Keeble, Oliver Cass, Tony The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS |
title | The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS |
title_full | The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS |
title_fullStr | The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS |
title_full_unstemmed | The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS |
title_short | The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS |
title_sort | noted software tool-set improves efficient network utilization for rucio data transfers via fts |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202024507022 http://cds.cern.ch/record/2752532 |
work_keys_str_mv | AT bussegrawitzcoralie thenotedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT martelliedoardo thenotedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT lassnigmario thenotedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT manziandrea thenotedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT keebleoliver thenotedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT casstony thenotedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT bussegrawitzcoralie notedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT martelliedoardo notedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT lassnigmario notedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT manziandrea notedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT keebleoliver notedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts AT casstony notedsoftwaretoolsetimprovesefficientnetworkutilizationforruciodatatransfersviafts |