Cargando…
Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources
<!--HTML-->Computing resource needs are expected to increase drastically in the future. The HEP experiments ATLAS and CMS foresee an increase of a factor of 5-10 in the volume of recorded data in the upcoming years. The current infrastructure, namely the WLCG, is not sufficient to meet the dem...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2021
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2767296 |
_version_ | 1780971289805062144 |
---|---|
author | Von Cube, Ralf Florian |
author_facet | Von Cube, Ralf Florian |
author_sort | Von Cube, Ralf Florian |
collection | CERN |
description | <!--HTML-->Computing resource needs are expected to increase drastically in the future. The HEP experiments ATLAS and CMS foresee an increase of a factor of 5-10 in the volume of recorded data in the upcoming years. The current infrastructure, namely the WLCG, is not sufficient to meet the demands in terms of computing and storage resources.
The usage of non HEP specific resources is one way to reduce this shortage. However, using them comes at a cost: First, with multiple of such resources at hand, it gets more and more difficult for the single user, as each resource normally requires its own authentication and has its own way of accessing it. Second, as they are not specifically designed for HEP workflows, they might lack dedicated software or other necessary services.
Allocating the resources at the different providers can be done by COBalD/TARDIS, developed at KIT. The resource manager integrates resources on demand into one overlay batch system, providing the user with a single point of entry. The software and services, needed for the communities workflows, are transparently served through containers.
With this, an HPC cluster at RWTH Aachen University is dynamically and transparently integrated into a tier 2 WLCG resource, virtually doubling its computing capacities. |
id | cern-2767296 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2021 |
record_format | invenio |
spelling | cern-27672962022-11-02T22:25:36Zhttp://cds.cern.ch/record/2767296engVon Cube, Ralf FlorianOpportunistic transparent extension of a WLCG Tier 2 center using HPC resources25th International Conference on Computing in High Energy & Nuclear PhysicsConferences<!--HTML-->Computing resource needs are expected to increase drastically in the future. The HEP experiments ATLAS and CMS foresee an increase of a factor of 5-10 in the volume of recorded data in the upcoming years. The current infrastructure, namely the WLCG, is not sufficient to meet the demands in terms of computing and storage resources. The usage of non HEP specific resources is one way to reduce this shortage. However, using them comes at a cost: First, with multiple of such resources at hand, it gets more and more difficult for the single user, as each resource normally requires its own authentication and has its own way of accessing it. Second, as they are not specifically designed for HEP workflows, they might lack dedicated software or other necessary services. Allocating the resources at the different providers can be done by COBalD/TARDIS, developed at KIT. The resource manager integrates resources on demand into one overlay batch system, providing the user with a single point of entry. The software and services, needed for the communities workflows, are transparently served through containers. With this, an HPC cluster at RWTH Aachen University is dynamically and transparently integrated into a tier 2 WLCG resource, virtually doubling its computing capacities.oai:cds.cern.ch:27672962021 |
spellingShingle | Conferences Von Cube, Ralf Florian Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources |
title | Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources |
title_full | Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources |
title_fullStr | Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources |
title_full_unstemmed | Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources |
title_short | Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources |
title_sort | opportunistic transparent extension of a wlcg tier 2 center using hpc resources |
topic | Conferences |
url | http://cds.cern.ch/record/2767296 |
work_keys_str_mv | AT voncuberalfflorian opportunistictransparentextensionofawlcgtier2centerusinghpcresources AT voncuberalfflorian 25thinternationalconferenceoncomputinginhighenergynuclearphysics |