Cargando…
Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows
The Worldwide LHC Computing Grid relies on the network as a critical part of its infrastructure and therefore needs to guarantee effective network usage and prompt detection and resolution of any network issues, including connection failures, congestion, traffic routing, etc. The WLCG Network and Tr...
Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/664/5/052003 http://cds.cern.ch/record/2134580 |
_version_ | 1780949909149581312 |
---|---|
author | McKee, S Babik, M Campana, S Girolamo, A Di Wildish, T Closier, J Roiser, S Grigoras, C Vukotic, I Salichos, M De, Kaushik Garonne, V Cruz, J A D Forti, A Walker, C J Rand, D de Salvo, A Mazzoni, E Gable, I Chollet, F Caillat, L Schaer, F Chen, Hsin-Yen Tigerstedt, U Duckeck, G Hoeft, B Petzold, A Lopez, F Flix, J Stancu, S Shade, J O'Connor, M Kotlyar, V Zurawski, J |
author_facet | McKee, S Babik, M Campana, S Girolamo, A Di Wildish, T Closier, J Roiser, S Grigoras, C Vukotic, I Salichos, M De, Kaushik Garonne, V Cruz, J A D Forti, A Walker, C J Rand, D de Salvo, A Mazzoni, E Gable, I Chollet, F Caillat, L Schaer, F Chen, Hsin-Yen Tigerstedt, U Duckeck, G Hoeft, B Petzold, A Lopez, F Flix, J Stancu, S Shade, J O'Connor, M Kotlyar, V Zurawski, J |
author_sort | McKee, S |
collection | CERN |
description | The Worldwide LHC Computing Grid relies on the network as a critical part of its infrastructure and therefore needs to guarantee effective network usage and prompt detection and resolution of any network issues, including connection failures, congestion, traffic routing, etc. The WLCG Network and Transfer Metrics project aims to integrate and combine all network-related monitoring data collected by the WLCG infrastructure. This includes FTS monitoring information, monitoring data from the XRootD federation, as well as results of the perfSONAR tests. The main challenge consists of further integrating and analyzing this information in order to allow the optimizing of data transfers and workload management systems of the LHC experiments. In this contribution, we present our activity in commissioning WLCG perfSONAR network and integrating network and transfer metrics: We motivate the need for the network performance monitoring, describe the main use cases of the LHC experiments as well as status and evolution in the areas of configuration and capacity management, datastore and analytics, including integration of transfer and network metrics and operations and support. |
id | oai-inspirehep.net-1413888 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | oai-inspirehep.net-14138882022-08-10T13:00:56Zdoi:10.1088/1742-6596/664/5/052003http://cds.cern.ch/record/2134580engMcKee, SBabik, MCampana, SGirolamo, A DiWildish, TClosier, JRoiser, SGrigoras, CVukotic, ISalichos, MDe, KaushikGaronne, VCruz, J A DForti, AWalker, C JRand, Dde Salvo, AMazzoni, EGable, IChollet, FCaillat, LSchaer, FChen, Hsin-YenTigerstedt, UDuckeck, GHoeft, BPetzold, ALopez, FFlix, JStancu, SShade, JO'Connor, MKotlyar, VZurawski, JIntegrating network and transfer metrics to optimize transfer efficiency and experiment workflowsComputing and ComputersThe Worldwide LHC Computing Grid relies on the network as a critical part of its infrastructure and therefore needs to guarantee effective network usage and prompt detection and resolution of any network issues, including connection failures, congestion, traffic routing, etc. The WLCG Network and Transfer Metrics project aims to integrate and combine all network-related monitoring data collected by the WLCG infrastructure. This includes FTS monitoring information, monitoring data from the XRootD federation, as well as results of the perfSONAR tests. The main challenge consists of further integrating and analyzing this information in order to allow the optimizing of data transfers and workload management systems of the LHC experiments. In this contribution, we present our activity in commissioning WLCG perfSONAR network and integrating network and transfer metrics: We motivate the need for the network performance monitoring, describe the main use cases of the LHC experiments as well as status and evolution in the areas of configuration and capacity management, datastore and analytics, including integration of transfer and network metrics and operations and support.oai:inspirehep.net:14138882015 |
spellingShingle | Computing and Computers McKee, S Babik, M Campana, S Girolamo, A Di Wildish, T Closier, J Roiser, S Grigoras, C Vukotic, I Salichos, M De, Kaushik Garonne, V Cruz, J A D Forti, A Walker, C J Rand, D de Salvo, A Mazzoni, E Gable, I Chollet, F Caillat, L Schaer, F Chen, Hsin-Yen Tigerstedt, U Duckeck, G Hoeft, B Petzold, A Lopez, F Flix, J Stancu, S Shade, J O'Connor, M Kotlyar, V Zurawski, J Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows |
title | Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows |
title_full | Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows |
title_fullStr | Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows |
title_full_unstemmed | Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows |
title_short | Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows |
title_sort | integrating network and transfer metrics to optimize transfer efficiency and experiment workflows |
topic | Computing and Computers |
url | https://dx.doi.org/10.1088/1742-6596/664/5/052003 http://cds.cern.ch/record/2134580 |
work_keys_str_mv | AT mckees integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT babikm integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT campanas integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT girolamoadi integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT wildisht integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT closierj integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT roisers integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT grigorasc integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT vukotici integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT salichosm integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT dekaushik integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT garonnev integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT cruzjad integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT fortia integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT walkercj integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT randd integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT desalvoa integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT mazzonie integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT gablei integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT cholletf integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT caillatl integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT schaerf integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT chenhsinyen integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT tigerstedtu integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT duckeckg integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT hoeftb integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT petzolda integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT lopezf integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT flixj integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT stancus integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT shadej integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT oconnorm integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT kotlyarv integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows AT zurawskij integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows |