Cargando…
Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project
A crucial contributor to the success of the massively scaled global computing system that delivers the analysis needs of the LHC experiments is the networking infrastructure upon which the system is built. The experiments have been able to exploit excellent high-bandwidth networking in adapting thei...
Autores principales: | , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2005213 |
_version_ | 1780946137673367552 |
---|---|
author | Klimentov, Alexei De, Kaushik Petrosyan, Artem Batista, Jorge Horacio Mc Kee, Shawn Patrick |
author_facet | Klimentov, Alexei De, Kaushik Petrosyan, Artem Batista, Jorge Horacio Mc Kee, Shawn Patrick |
author_sort | Klimentov, Alexei |
collection | CERN |
description | A crucial contributor to the success of the massively scaled global computing system that delivers the analysis needs of the LHC experiments is the networking infrastructure upon which the system is built. The experiments have been able to exploit excellent high-bandwidth networking in adapting their computing models for the most efficient utilization of resources. New advanced networking technologies now becoming available such as software defined networking hold the potential of further leveraging the network to optimize workflows and dataflows, through proactive control of the network fabric on the part of high level applications such as experiment workload management and data management systems. End to end monitoring of networks using perfSONAR combined with data flow performance metrics further allows applications to adapt based on real time conditions. We will describe efforts underway in ATLAS on integrating network awareness at the application level, particularly in workload management, building upon the ANSE (Advance Network Services for Experiments) project components. We will show how knowledge of network conditions, both historical and current, are used to optimize PanDA and other systems for ATLAS and describe how software control of end-to-end network paths can augment ATLAS's ability to effectively utilize its distributed resources. |
id | cern-2005213 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | cern-20052132019-09-30T06:29:59Zhttp://cds.cern.ch/record/2005213engKlimentov, AlexeiDe, KaushikPetrosyan, ArtemBatista, Jorge HoracioMc Kee, Shawn PatrickIntegrating Network Awareness in ATLAS Distributed Computing Using the ANSE ProjectParticle Physics - ExperimentA crucial contributor to the success of the massively scaled global computing system that delivers the analysis needs of the LHC experiments is the networking infrastructure upon which the system is built. The experiments have been able to exploit excellent high-bandwidth networking in adapting their computing models for the most efficient utilization of resources. New advanced networking technologies now becoming available such as software defined networking hold the potential of further leveraging the network to optimize workflows and dataflows, through proactive control of the network fabric on the part of high level applications such as experiment workload management and data management systems. End to end monitoring of networks using perfSONAR combined with data flow performance metrics further allows applications to adapt based on real time conditions. We will describe efforts underway in ATLAS on integrating network awareness at the application level, particularly in workload management, building upon the ANSE (Advance Network Services for Experiments) project components. We will show how knowledge of network conditions, both historical and current, are used to optimize PanDA and other systems for ATLAS and describe how software control of end-to-end network paths can augment ATLAS's ability to effectively utilize its distributed resources.ATL-SOFT-SLIDE-2015-123oai:cds.cern.ch:20052132015-03-30 |
spellingShingle | Particle Physics - Experiment Klimentov, Alexei De, Kaushik Petrosyan, Artem Batista, Jorge Horacio Mc Kee, Shawn Patrick Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project |
title | Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project |
title_full | Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project |
title_fullStr | Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project |
title_full_unstemmed | Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project |
title_short | Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project |
title_sort | integrating network awareness in atlas distributed computing using the anse project |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2005213 |
work_keys_str_mv | AT klimentovalexei integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject AT dekaushik integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject AT petrosyanartem integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject AT batistajorgehoracio integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject AT mckeeshawnpatrick integratingnetworkawarenessinatlasdistributedcomputingusingtheanseproject |