Cargando…

Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources

<!--HTML-->Computing resource needs are expected to increase drastically in the future. The HEP experiments ATLAS and CMS foresee an increase of a factor of 5-10 in the volume of recorded data in the upcoming years. The current infrastructure, namely the WLCG, is not sufficient to meet the dem...

Descripción completa

Detalles Bibliográficos
Autor principal: Von Cube, Ralf Florian
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2767296
_version_ 1780971289805062144
author Von Cube, Ralf Florian
author_facet Von Cube, Ralf Florian
author_sort Von Cube, Ralf Florian
collection CERN
description <!--HTML-->Computing resource needs are expected to increase drastically in the future. The HEP experiments ATLAS and CMS foresee an increase of a factor of 5-10 in the volume of recorded data in the upcoming years. The current infrastructure, namely the WLCG, is not sufficient to meet the demands in terms of computing and storage resources. The usage of non HEP specific resources is one way to reduce this shortage. However, using them comes at a cost: First, with multiple of such resources at hand, it gets more and more difficult for the single user, as each resource normally requires its own authentication and has its own way of accessing it. Second, as they are not specifically designed for HEP workflows, they might lack dedicated software or other necessary services. Allocating the resources at the different providers can be done by COBalD/TARDIS, developed at KIT. The resource manager integrates resources on demand into one overlay batch system, providing the user with a single point of entry. The software and services, needed for the communities workflows, are transparently served through containers. With this, an HPC cluster at RWTH Aachen University is dynamically and transparently integrated into a tier 2 WLCG resource, virtually doubling its computing capacities.
id cern-2767296
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27672962022-11-02T22:25:36Zhttp://cds.cern.ch/record/2767296engVon Cube, Ralf FlorianOpportunistic transparent extension of a WLCG Tier 2 center using HPC resources25th International Conference on Computing in High Energy & Nuclear PhysicsConferences<!--HTML-->Computing resource needs are expected to increase drastically in the future. The HEP experiments ATLAS and CMS foresee an increase of a factor of 5-10 in the volume of recorded data in the upcoming years. The current infrastructure, namely the WLCG, is not sufficient to meet the demands in terms of computing and storage resources. The usage of non HEP specific resources is one way to reduce this shortage. However, using them comes at a cost: First, with multiple of such resources at hand, it gets more and more difficult for the single user, as each resource normally requires its own authentication and has its own way of accessing it. Second, as they are not specifically designed for HEP workflows, they might lack dedicated software or other necessary services. Allocating the resources at the different providers can be done by COBalD/TARDIS, developed at KIT. The resource manager integrates resources on demand into one overlay batch system, providing the user with a single point of entry. The software and services, needed for the communities workflows, are transparently served through containers. With this, an HPC cluster at RWTH Aachen University is dynamically and transparently integrated into a tier 2 WLCG resource, virtually doubling its computing capacities.oai:cds.cern.ch:27672962021
spellingShingle Conferences
Von Cube, Ralf Florian
Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources
title Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources
title_full Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources
title_fullStr Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources
title_full_unstemmed Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources
title_short Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources
title_sort opportunistic transparent extension of a wlcg tier 2 center using hpc resources
topic Conferences
url http://cds.cern.ch/record/2767296
work_keys_str_mv AT voncuberalfflorian opportunistictransparentextensionofawlcgtier2centerusinghpcresources
AT voncuberalfflorian 25thinternationalconferenceoncomputinginhighenergynuclearphysics