Cargando…

Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows

The Worldwide LHC Computing Grid relies on the network as a critical part of its infrastructure and therefore needs to guarantee effective network usage and prompt detection and resolution of any network issues, including connection failures, congestion, traffic routing, etc. The WLCG Network and Tr...

Descripción completa

Detalles Bibliográficos
Autores principales: McKee, S, Babik, M, Campana, S, Girolamo, A Di, Wildish, T, Closier, J, Roiser, S, Grigoras, C, Vukotic, I, Salichos, M, De, Kaushik, Garonne, V, Cruz, J A D, Forti, A, Walker, C J, Rand, D, de Salvo, A, Mazzoni, E, Gable, I, Chollet, F, Caillat, L, Schaer, F, Chen, Hsin-Yen, Tigerstedt, U, Duckeck, G, Hoeft, B, Petzold, A, Lopez, F, Flix, J, Stancu, S, Shade, J, O'Connor, M, Kotlyar, V, Zurawski, J
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/664/5/052003
http://cds.cern.ch/record/2134580
_version_ 1780949909149581312
author McKee, S
Babik, M
Campana, S
Girolamo, A Di
Wildish, T
Closier, J
Roiser, S
Grigoras, C
Vukotic, I
Salichos, M
De, Kaushik
Garonne, V
Cruz, J A D
Forti, A
Walker, C J
Rand, D
de Salvo, A
Mazzoni, E
Gable, I
Chollet, F
Caillat, L
Schaer, F
Chen, Hsin-Yen
Tigerstedt, U
Duckeck, G
Hoeft, B
Petzold, A
Lopez, F
Flix, J
Stancu, S
Shade, J
O'Connor, M
Kotlyar, V
Zurawski, J
author_facet McKee, S
Babik, M
Campana, S
Girolamo, A Di
Wildish, T
Closier, J
Roiser, S
Grigoras, C
Vukotic, I
Salichos, M
De, Kaushik
Garonne, V
Cruz, J A D
Forti, A
Walker, C J
Rand, D
de Salvo, A
Mazzoni, E
Gable, I
Chollet, F
Caillat, L
Schaer, F
Chen, Hsin-Yen
Tigerstedt, U
Duckeck, G
Hoeft, B
Petzold, A
Lopez, F
Flix, J
Stancu, S
Shade, J
O'Connor, M
Kotlyar, V
Zurawski, J
author_sort McKee, S
collection CERN
description The Worldwide LHC Computing Grid relies on the network as a critical part of its infrastructure and therefore needs to guarantee effective network usage and prompt detection and resolution of any network issues, including connection failures, congestion, traffic routing, etc. The WLCG Network and Transfer Metrics project aims to integrate and combine all network-related monitoring data collected by the WLCG infrastructure. This includes FTS monitoring information, monitoring data from the XRootD federation, as well as results of the perfSONAR tests. The main challenge consists of further integrating and analyzing this information in order to allow the optimizing of data transfers and workload management systems of the LHC experiments. In this contribution, we present our activity in commissioning WLCG perfSONAR network and integrating network and transfer metrics: We motivate the need for the network performance monitoring, describe the main use cases of the LHC experiments as well as status and evolution in the areas of configuration and capacity management, datastore and analytics, including integration of transfer and network metrics and operations and support.
id oai-inspirehep.net-1413888
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling oai-inspirehep.net-14138882022-08-10T13:00:56Zdoi:10.1088/1742-6596/664/5/052003http://cds.cern.ch/record/2134580engMcKee, SBabik, MCampana, SGirolamo, A DiWildish, TClosier, JRoiser, SGrigoras, CVukotic, ISalichos, MDe, KaushikGaronne, VCruz, J A DForti, AWalker, C JRand, Dde Salvo, AMazzoni, EGable, IChollet, FCaillat, LSchaer, FChen, Hsin-YenTigerstedt, UDuckeck, GHoeft, BPetzold, ALopez, FFlix, JStancu, SShade, JO'Connor, MKotlyar, VZurawski, JIntegrating network and transfer metrics to optimize transfer efficiency and experiment workflowsComputing and ComputersThe Worldwide LHC Computing Grid relies on the network as a critical part of its infrastructure and therefore needs to guarantee effective network usage and prompt detection and resolution of any network issues, including connection failures, congestion, traffic routing, etc. The WLCG Network and Transfer Metrics project aims to integrate and combine all network-related monitoring data collected by the WLCG infrastructure. This includes FTS monitoring information, monitoring data from the XRootD federation, as well as results of the perfSONAR tests. The main challenge consists of further integrating and analyzing this information in order to allow the optimizing of data transfers and workload management systems of the LHC experiments. In this contribution, we present our activity in commissioning WLCG perfSONAR network and integrating network and transfer metrics: We motivate the need for the network performance monitoring, describe the main use cases of the LHC experiments as well as status and evolution in the areas of configuration and capacity management, datastore and analytics, including integration of transfer and network metrics and operations and support.oai:inspirehep.net:14138882015
spellingShingle Computing and Computers
McKee, S
Babik, M
Campana, S
Girolamo, A Di
Wildish, T
Closier, J
Roiser, S
Grigoras, C
Vukotic, I
Salichos, M
De, Kaushik
Garonne, V
Cruz, J A D
Forti, A
Walker, C J
Rand, D
de Salvo, A
Mazzoni, E
Gable, I
Chollet, F
Caillat, L
Schaer, F
Chen, Hsin-Yen
Tigerstedt, U
Duckeck, G
Hoeft, B
Petzold, A
Lopez, F
Flix, J
Stancu, S
Shade, J
O'Connor, M
Kotlyar, V
Zurawski, J
Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows
title Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows
title_full Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows
title_fullStr Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows
title_full_unstemmed Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows
title_short Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows
title_sort integrating network and transfer metrics to optimize transfer efficiency and experiment workflows
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/664/5/052003
http://cds.cern.ch/record/2134580
work_keys_str_mv AT mckees integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT babikm integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT campanas integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT girolamoadi integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT wildisht integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT closierj integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT roisers integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT grigorasc integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT vukotici integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT salichosm integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT dekaushik integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT garonnev integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT cruzjad integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT fortia integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT walkercj integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT randd integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT desalvoa integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT mazzonie integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT gablei integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT cholletf integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT caillatl integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT schaerf integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT chenhsinyen integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT tigerstedtu integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT duckeckg integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT hoeftb integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT petzolda integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT lopezf integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT flixj integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT stancus integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT shadej integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT oconnorm integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT kotlyarv integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows
AT zurawskij integratingnetworkandtransfermetricstooptimizetransferefficiencyandexperimentworkflows