Cargando…

Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project

A crucial contributor to the success of the massively scaled global computing system that delivers the analysis needs of the LHC experiments is the networking infrastructure upon which the system is built. The experiments have been able to exploit excellent high-bandwidth networking in adapting thei...

Descripción completa

Detalles Bibliográficos
Autores principales: Klimentov, Alexei, De, Kaushik, Petrosyan, Artem, Batista, Jorge Horacio, Mc Kee, Shawn Patrick
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:http://cds.cern.ch/record/2005213
_version_ 1780946137673367552
author Klimentov, Alexei
De, Kaushik
Petrosyan, Artem
Batista, Jorge Horacio
Mc Kee, Shawn Patrick
author_facet Klimentov, Alexei
De, Kaushik
Petrosyan, Artem
Batista, Jorge Horacio
Mc Kee, Shawn Patrick
author_sort Klimentov, Alexei
collection CERN
description A crucial contributor to the success of the massively scaled global computing system that delivers the analysis needs of the LHC experiments is the networking infrastructure upon which the system is built. The experiments have been able to exploit excellent high-bandwidth networking in adapting their computing models for the most efficient utilization of resources. New advanced networking technologies now becoming available such as software defined networking hold the potential of further leveraging the network to optimize workflows and dataflows, through proactive control of the network fabric on the part of high level applications such as experiment workload management and data management systems. End to end monitoring of networks using perfSONAR combined with data flow performance metrics further allows applications to adapt based on real time conditions. We will describe efforts underway in ATLAS on integrating network awareness at the application level, particularly in workload management, building upon the ANSE (Advance Network Services for Experiments) project components. We will show how knowledge of network conditions, both historical and current, are used to optimize PanDA and other systems for ATLAS and describe how software control of end-to-end network paths can augment ATLAS's ability to effectively utilize its distributed resources.
id cern-2005213
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling cern-20052132019-09-30T06:29:59Zhttp://cds.cern.ch/record/2005213engKlimentov, AlexeiDe, KaushikPetrosyan, ArtemBatista, Jorge HoracioMc Kee, Shawn PatrickIntegrating Network Awareness in ATLAS Distributed Computing Using the ANSE ProjectParticle Physics - ExperimentA crucial contributor to the success of the massively scaled global computing system that delivers the analysis needs of the LHC experiments is the networking infrastructure upon which the system is built. The experiments have been able to exploit excellent high-bandwidth networking in adapting their computing models for the most efficient utilization of resources. New advanced networking technologies now becoming available such as software defined networking hold the potential of further leveraging the network to optimize workflows and dataflows, through proactive control of the network fabric on the part of high level applications such as experiment workload management and data management systems. End to end monitoring of networks using perfSONAR combined with data flow performance metrics further allows applications to adapt based on real time conditions. We will describe efforts underway in ATLAS on integrating network awareness at the application level, particularly in workload management, building upon the ANSE (Advance Network Services for Experiments) project components. We will show how knowledge of network conditions, both historical and current, are used to optimize PanDA and other systems for ATLAS and describe how software control of end-to-end network paths can augment ATLAS's ability to effectively utilize its distributed resources.ATL-SOFT-SLIDE-2015-123oai:cds.cern.ch:20052132015-03-30
spellingShingle Particle Physics - Experiment
Klimentov, Alexei
De, Kaushik
Petrosyan, Artem
Batista, Jorge Horacio
Mc Kee, Shawn Patrick
Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project
title Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project
title_full Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project
title_fullStr Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project
title_full_unstemmed Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project
title_short Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project
title_sort integrating network awareness in atlas distributed computing using the anse project
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2005213
work_keys_str_mv AT klimentovalexei integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject
AT dekaushik integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject
AT petrosyanartem integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject
AT batistajorgehoracio integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject
AT mckeeshawnpatrick integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject