Cargando…

Deploying a new realtime XRootD-v5 based monitoring framework for GridPP

<!--HTML-->To optimise the performance of distributed compute, smaller lightweight storage caches are needed which integrate with existing grid computing workflows. A good solution to provide lightweight storage caches is to use an XRootD-proxy cache. To support distributed lightweight XRootD...

Descripción completa

Detalles Bibliográficos
Autor principal: Currie, Robert Andrew
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2767079
_version_ 1780971268146724864
author Currie, Robert Andrew
author_facet Currie, Robert Andrew
author_sort Currie, Robert Andrew
collection CERN
description <!--HTML-->To optimise the performance of distributed compute, smaller lightweight storage caches are needed which integrate with existing grid computing workflows. A good solution to provide lightweight storage caches is to use an XRootD-proxy cache. To support distributed lightweight XRootD proxy services across GridPP we have developed a centralised monitoring framework. With the v5 release of XRootD it is possible to build a monitoring framework which collects distributed caching metadata broadcast from multiple sites. To provide the best support for these distributed caches we have built a centralised monitoring service for XRootD storage instances within GridPP. This monitoring solution is built upon experiences presented by CMS in setting up a similar service as part of their AAA system. This new framework is designed to provide remote monitoring of the behaviour, performance, and reliability of distributed XRootD services across the UK. Effort has been made to simplify ease of deployment by remote site administrators. The result of this work is an interactive dashboard system which enables administrators to access real-time metrics on the performance of their lightweight storage systems. This monitoring framework is intended to supplement existing functionality and availability testing metrics by providing detailed information and logging from a site perspective.
id cern-2767079
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27670792022-11-02T22:25:40Zhttp://cds.cern.ch/record/2767079engCurrie, Robert AndrewDeploying a new realtime XRootD-v5 based monitoring framework for GridPP25th International Conference on Computing in High Energy & Nuclear PhysicsConferences<!--HTML-->To optimise the performance of distributed compute, smaller lightweight storage caches are needed which integrate with existing grid computing workflows. A good solution to provide lightweight storage caches is to use an XRootD-proxy cache. To support distributed lightweight XRootD proxy services across GridPP we have developed a centralised monitoring framework. With the v5 release of XRootD it is possible to build a monitoring framework which collects distributed caching metadata broadcast from multiple sites. To provide the best support for these distributed caches we have built a centralised monitoring service for XRootD storage instances within GridPP. This monitoring solution is built upon experiences presented by CMS in setting up a similar service as part of their AAA system. This new framework is designed to provide remote monitoring of the behaviour, performance, and reliability of distributed XRootD services across the UK. Effort has been made to simplify ease of deployment by remote site administrators. The result of this work is an interactive dashboard system which enables administrators to access real-time metrics on the performance of their lightweight storage systems. This monitoring framework is intended to supplement existing functionality and availability testing metrics by providing detailed information and logging from a site perspective.oai:cds.cern.ch:27670792021
spellingShingle Conferences
Currie, Robert Andrew
Deploying a new realtime XRootD-v5 based monitoring framework for GridPP
title Deploying a new realtime XRootD-v5 based monitoring framework for GridPP
title_full Deploying a new realtime XRootD-v5 based monitoring framework for GridPP
title_fullStr Deploying a new realtime XRootD-v5 based monitoring framework for GridPP
title_full_unstemmed Deploying a new realtime XRootD-v5 based monitoring framework for GridPP
title_short Deploying a new realtime XRootD-v5 based monitoring framework for GridPP
title_sort deploying a new realtime xrootd-v5 based monitoring framework for gridpp
topic Conferences
url http://cds.cern.ch/record/2767079
work_keys_str_mv AT currierobertandrew deployinganewrealtimexrootdv5basedmonitoringframeworkforgridpp
AT currierobertandrew 25thinternationalconferenceoncomputinginhighenergynuclearphysics