Cargando…

Updates on usage of the Czech national HPC center

The distributed computing of the ATLAS experiment at LHC is using computing resources of the Czech national HPC center IT4Innovations for several years. The submission system is based on ARC-CEs installed at the Czech Tier2 site (praguelcg2). Recent improvements of this system will be discussed here...

Descripción completa

Detalles Bibliográficos
Autores principales: Svatos, Michal, Chudoba, Jiri, Vokac, Petr
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202125102008
http://cds.cern.ch/record/2771478
_version_ 1780971354183434240
author Svatos, Michal
Chudoba, Jiri
Vokac, Petr
author_facet Svatos, Michal
Chudoba, Jiri
Vokac, Petr
author_sort Svatos, Michal
collection CERN
description The distributed computing of the ATLAS experiment at LHC is using computing resources of the Czech national HPC center IT4Innovations for several years. The submission system is based on ARC-CEs installed at the Czech Tier2 site (praguelcg2). Recent improvements of this system will be discussed here. First, there was a migration of the ARC-CE from version 5 to 6 which improves the reliability and scalability. Shared filesystem built on top of recent sshfs no longer represent performance bottleneck. It was possible to achieve order of magnitude better transfer performance with it. New singularity containers with full software stack can easily fit default resource limits on the IT4I cluster filesystem. System allowing sequential running of payloads in one job was adapted to HPC's environment, improving usage on worker nodes with very high number of cores. Overall, the system provides significant contribution to resources provided by praguelcg2.
id cern-2771478
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27714782022-08-23T21:03:48Zdoi:10.1051/epjconf/202125102008http://cds.cern.ch/record/2771478engSvatos, MichalChudoba, JiriVokac, PetrUpdates on usage of the Czech national HPC centerParticle Physics - ExperimentThe distributed computing of the ATLAS experiment at LHC is using computing resources of the Czech national HPC center IT4Innovations for several years. The submission system is based on ARC-CEs installed at the Czech Tier2 site (praguelcg2). Recent improvements of this system will be discussed here. First, there was a migration of the ARC-CE from version 5 to 6 which improves the reliability and scalability. Shared filesystem built on top of recent sshfs no longer represent performance bottleneck. It was possible to achieve order of magnitude better transfer performance with it. New singularity containers with full software stack can easily fit default resource limits on the IT4I cluster filesystem. System allowing sequential running of payloads in one job was adapted to HPC's environment, improving usage on worker nodes with very high number of cores. Overall, the system provides significant contribution to resources provided by praguelcg2.ATL-SOFT-PROC-2021-006oai:cds.cern.ch:27714782021-06-03
spellingShingle Particle Physics - Experiment
Svatos, Michal
Chudoba, Jiri
Vokac, Petr
Updates on usage of the Czech national HPC center
title Updates on usage of the Czech national HPC center
title_full Updates on usage of the Czech national HPC center
title_fullStr Updates on usage of the Czech national HPC center
title_full_unstemmed Updates on usage of the Czech national HPC center
title_short Updates on usage of the Czech national HPC center
title_sort updates on usage of the czech national hpc center
topic Particle Physics - Experiment
url https://dx.doi.org/10.1051/epjconf/202125102008
http://cds.cern.ch/record/2771478
work_keys_str_mv AT svatosmichal updatesonusageoftheczechnationalhpccenter
AT chudobajiri updatesonusageoftheczechnationalhpccenter
AT vokacpetr updatesonusageoftheczechnationalhpccenter