Cargando…

Exploitation of the MareNostrum 4 HPC using ARC-CE

<!--HTML-->HPC resources will help meet the future challenges of HL-LHC in terms of CPU requirements. The Spanish HPC centers have been used recently by implementing all the necessary edge services to integrate the resources into the LHC experiments workflow management system. Since it not alw...

Descripción completa

Detalles Bibliográficos
Autor principal: Pacheco Pages, Andreu
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2767272
_version_ 1780971287569498112
author Pacheco Pages, Andreu
author_facet Pacheco Pages, Andreu
author_sort Pacheco Pages, Andreu
collection CERN
description <!--HTML-->HPC resources will help meet the future challenges of HL-LHC in terms of CPU requirements. The Spanish HPC centers have been used recently by implementing all the necessary edge services to integrate the resources into the LHC experiments workflow management system. Since it not always possible to install the edge services on HPC premises, we opted to set up a dedicated ARC-CE and interact with the HPC login and transfer nodes using ssh commands. In the ATLAS experiment, the repository that includes a partial copy of the experiment software in CVMFS is packaged into a container singularity image to overcome network isolation for HPC worker nodes and reduce software requirements. This article shows the Spanish contribution to the simulation of experiments after the agreement between the Spanish Ministry of Science and the Barcelona Supercomputing Center (BSC), the center that operates MareNostrum 4. Finally, we discuss some challenges to take advantage of HPC machines' next generation with heterogeneous architecture combining CPU and GPU.
id cern-2767272
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27672722022-11-02T22:25:36Zhttp://cds.cern.ch/record/2767272engPacheco Pages, AndreuExploitation of the MareNostrum 4 HPC using ARC-CE25th International Conference on Computing in High Energy & Nuclear PhysicsConferences<!--HTML-->HPC resources will help meet the future challenges of HL-LHC in terms of CPU requirements. The Spanish HPC centers have been used recently by implementing all the necessary edge services to integrate the resources into the LHC experiments workflow management system. Since it not always possible to install the edge services on HPC premises, we opted to set up a dedicated ARC-CE and interact with the HPC login and transfer nodes using ssh commands. In the ATLAS experiment, the repository that includes a partial copy of the experiment software in CVMFS is packaged into a container singularity image to overcome network isolation for HPC worker nodes and reduce software requirements. This article shows the Spanish contribution to the simulation of experiments after the agreement between the Spanish Ministry of Science and the Barcelona Supercomputing Center (BSC), the center that operates MareNostrum 4. Finally, we discuss some challenges to take advantage of HPC machines' next generation with heterogeneous architecture combining CPU and GPU.oai:cds.cern.ch:27672722021
spellingShingle Conferences
Pacheco Pages, Andreu
Exploitation of the MareNostrum 4 HPC using ARC-CE
title Exploitation of the MareNostrum 4 HPC using ARC-CE
title_full Exploitation of the MareNostrum 4 HPC using ARC-CE
title_fullStr Exploitation of the MareNostrum 4 HPC using ARC-CE
title_full_unstemmed Exploitation of the MareNostrum 4 HPC using ARC-CE
title_short Exploitation of the MareNostrum 4 HPC using ARC-CE
title_sort exploitation of the marenostrum 4 hpc using arc-ce
topic Conferences
url http://cds.cern.ch/record/2767272
work_keys_str_mv AT pachecopagesandreu exploitationofthemarenostrum4hpcusingarcce
AT pachecopagesandreu 25thinternationalconferenceoncomputinginhighenergynuclearphysics