Cargando…

Distributed cluster testing using new virtualized framework for XRootD

The Extended ROOT Daemon (XRootD) is a distributed, scalable system for low-latency clustered data access. XRootD is mature and widely used in HEP, both standalone and as a core server framework for the EOS system at CERN, and hence requires extensive testing to ensure general stability. However, th...

Descripción completa

Detalles Bibliográficos
Autores principales: Salmon, Justin L, Janyst, Lukasz
Lenguaje:eng
Publicado: 2014
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/513/6/062042
http://cds.cern.ch/record/2025733
_version_ 1780947205071306752
author Salmon, Justin L
Janyst, Lukasz
author_facet Salmon, Justin L
Janyst, Lukasz
author_sort Salmon, Justin L
collection CERN
description The Extended ROOT Daemon (XRootD) is a distributed, scalable system for low-latency clustered data access. XRootD is mature and widely used in HEP, both standalone and as a core server framework for the EOS system at CERN, and hence requires extensive testing to ensure general stability. However, there are many difficulties posed by distributed testing, such as cluster set up, synchronization, orchestration, inter-cluster communication and controlled failure handling. A three-layer master/hypervisor/slave model is presented to ameloirate these difficulties by utilizing libvirt and QEMU/KVM virtualization technologies to automate spawning of configurable virtual clusters and orchestrate multi-stage test suites. The framework also incorporates a user-friendly web interface for scheduling and monitoring tests. The prototype has been used successfully to build new test suites for XRootD and EOS with existing unit test integration. It is planned for the future to sufficiently generalize the framework to encourage usage by potentially any distributed system.
id oai-inspirehep.net-1302200
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2014
record_format invenio
spelling oai-inspirehep.net-13022002022-08-17T13:27:45Zdoi:10.1088/1742-6596/513/6/062042http://cds.cern.ch/record/2025733engSalmon, Justin LJanyst, LukaszDistributed cluster testing using new virtualized framework for XRootDComputing and ComputersThe Extended ROOT Daemon (XRootD) is a distributed, scalable system for low-latency clustered data access. XRootD is mature and widely used in HEP, both standalone and as a core server framework for the EOS system at CERN, and hence requires extensive testing to ensure general stability. However, there are many difficulties posed by distributed testing, such as cluster set up, synchronization, orchestration, inter-cluster communication and controlled failure handling. A three-layer master/hypervisor/slave model is presented to ameloirate these difficulties by utilizing libvirt and QEMU/KVM virtualization technologies to automate spawning of configurable virtual clusters and orchestrate multi-stage test suites. The framework also incorporates a user-friendly web interface for scheduling and monitoring tests. The prototype has been used successfully to build new test suites for XRootD and EOS with existing unit test integration. It is planned for the future to sufficiently generalize the framework to encourage usage by potentially any distributed system.oai:inspirehep.net:13022002014
spellingShingle Computing and Computers
Salmon, Justin L
Janyst, Lukasz
Distributed cluster testing using new virtualized framework for XRootD
title Distributed cluster testing using new virtualized framework for XRootD
title_full Distributed cluster testing using new virtualized framework for XRootD
title_fullStr Distributed cluster testing using new virtualized framework for XRootD
title_full_unstemmed Distributed cluster testing using new virtualized framework for XRootD
title_short Distributed cluster testing using new virtualized framework for XRootD
title_sort distributed cluster testing using new virtualized framework for xrootd
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/513/6/062042
http://cds.cern.ch/record/2025733
work_keys_str_mv AT salmonjustinl distributedclustertestingusingnewvirtualizedframeworkforxrootd
AT janystlukasz distributedclustertestingusingnewvirtualizedframeworkforxrootd