Cargando…
Updates on usage of the Czech national HPC center
The distributed computing of the ATLAS experiment at LHC is using computing resources of the Czech national HPC center IT4Innovations for several years. The submission system is based on ARC-CEs installed at the Czech Tier2 site (praguelcg2). Recent improvements of this system will be discussed here...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2021
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202125102008 http://cds.cern.ch/record/2771478 |
_version_ | 1780971354183434240 |
---|---|
author | Svatos, Michal Chudoba, Jiri Vokac, Petr |
author_facet | Svatos, Michal Chudoba, Jiri Vokac, Petr |
author_sort | Svatos, Michal |
collection | CERN |
description | The distributed computing of the ATLAS experiment at LHC is using computing resources of the Czech national HPC center IT4Innovations for several years. The submission system is based on ARC-CEs installed at the Czech Tier2 site (praguelcg2). Recent improvements of this system will be discussed here. First, there was a migration of the ARC-CE from version 5 to 6 which improves the reliability and scalability. Shared filesystem built on top of recent sshfs no longer represent performance bottleneck. It was possible to achieve order of magnitude better transfer performance with it. New singularity containers with full software stack can easily fit default resource limits on the IT4I cluster filesystem. System allowing sequential running of payloads in one job was adapted to HPC's environment, improving usage on worker nodes with very high number of cores. Overall, the system provides significant contribution to resources provided by praguelcg2. |
id | cern-2771478 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2021 |
record_format | invenio |
spelling | cern-27714782022-08-23T21:03:48Zdoi:10.1051/epjconf/202125102008http://cds.cern.ch/record/2771478engSvatos, MichalChudoba, JiriVokac, PetrUpdates on usage of the Czech national HPC centerParticle Physics - ExperimentThe distributed computing of the ATLAS experiment at LHC is using computing resources of the Czech national HPC center IT4Innovations for several years. The submission system is based on ARC-CEs installed at the Czech Tier2 site (praguelcg2). Recent improvements of this system will be discussed here. First, there was a migration of the ARC-CE from version 5 to 6 which improves the reliability and scalability. Shared filesystem built on top of recent sshfs no longer represent performance bottleneck. It was possible to achieve order of magnitude better transfer performance with it. New singularity containers with full software stack can easily fit default resource limits on the IT4I cluster filesystem. System allowing sequential running of payloads in one job was adapted to HPC's environment, improving usage on worker nodes with very high number of cores. Overall, the system provides significant contribution to resources provided by praguelcg2.ATL-SOFT-PROC-2021-006oai:cds.cern.ch:27714782021-06-03 |
spellingShingle | Particle Physics - Experiment Svatos, Michal Chudoba, Jiri Vokac, Petr Updates on usage of the Czech national HPC center |
title | Updates on usage of the Czech national HPC center |
title_full | Updates on usage of the Czech national HPC center |
title_fullStr | Updates on usage of the Czech national HPC center |
title_full_unstemmed | Updates on usage of the Czech national HPC center |
title_short | Updates on usage of the Czech national HPC center |
title_sort | updates on usage of the czech national hpc center |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1051/epjconf/202125102008 http://cds.cern.ch/record/2771478 |
work_keys_str_mv | AT svatosmichal updatesonusageoftheczechnationalhpccenter AT chudobajiri updatesonusageoftheczechnationalhpccenter AT vokacpetr updatesonusageoftheczechnationalhpccenter |