Cargando…

Improvements in utilisation of the Czech national HPC center by ATLAS distributed computing

The ATLAS distributed computing is allowed to opportunistically use resources of the Czech national HPC center IT4Innovations in Ostrava. The jobs are submitted via an ARC Compute Element (ARC-CE) installed at the grid site in Prague. Scripts and input files are shared between the ARC-CE and shared...

Descripción completa

Detalles Bibliográficos
Autores principales: Svatos, Michal, Chudoba, Jiri, Vokac, Petr
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:http://cds.cern.ch/record/2696090
_version_ 1780964160616529920
author Svatos, Michal
Chudoba, Jiri
Vokac, Petr
author_facet Svatos, Michal
Chudoba, Jiri
Vokac, Petr
author_sort Svatos, Michal
collection CERN
description The ATLAS distributed computing is allowed to opportunistically use resources of the Czech national HPC center IT4Innovations in Ostrava. The jobs are submitted via an ARC Compute Element (ARC-CE) installed at the grid site in Prague. Scripts and input files are shared between the ARC-CE and shared file system located at the HPC via sshfs. This basic submission system has worked there since the end of 2017. Several improvements were made to increase amount of resource that ATLAS can use. The most significant one was the migration of the submission system to enable pre-emptable jobs, as the HPC management made the decision to use pre-emption on opportunistic jobs. Another improvement of the submission system is related to the sshfs connection which seemed to be a limiting factor of the system. Now, the submission system consists of several ARC-CE machines. Also, various parameters of sshfs were tested in an attempt to increase throughput. As a result of the improvements, the utilisation of the Czech national HPC center by the ATLAS distributed computing increased.
id cern-2696090
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26960902022-10-20T13:54:16Zhttp://cds.cern.ch/record/2696090engSvatos, MichalChudoba, JiriVokac, PetrImprovements in utilisation of the Czech national HPC center by ATLAS distributed computingParticle Physics - ExperimentThe ATLAS distributed computing is allowed to opportunistically use resources of the Czech national HPC center IT4Innovations in Ostrava. The jobs are submitted via an ARC Compute Element (ARC-CE) installed at the grid site in Prague. Scripts and input files are shared between the ARC-CE and shared file system located at the HPC via sshfs. This basic submission system has worked there since the end of 2017. Several improvements were made to increase amount of resource that ATLAS can use. The most significant one was the migration of the submission system to enable pre-emptable jobs, as the HPC management made the decision to use pre-emption on opportunistic jobs. Another improvement of the submission system is related to the sshfs connection which seemed to be a limiting factor of the system. Now, the submission system consists of several ARC-CE machines. Also, various parameters of sshfs were tested in an attempt to increase throughput. As a result of the improvements, the utilisation of the Czech national HPC center by the ATLAS distributed computing increased.ATL-SOFT-SLIDE-2019-800oai:cds.cern.ch:26960902019-10-24
spellingShingle Particle Physics - Experiment
Svatos, Michal
Chudoba, Jiri
Vokac, Petr
Improvements in utilisation of the Czech national HPC center by ATLAS distributed computing
title Improvements in utilisation of the Czech national HPC center by ATLAS distributed computing
title_full Improvements in utilisation of the Czech national HPC center by ATLAS distributed computing
title_fullStr Improvements in utilisation of the Czech national HPC center by ATLAS distributed computing
title_full_unstemmed Improvements in utilisation of the Czech national HPC center by ATLAS distributed computing
title_short Improvements in utilisation of the Czech national HPC center by ATLAS distributed computing
title_sort improvements in utilisation of the czech national hpc center by atlas distributed computing
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2696090
work_keys_str_mv AT svatosmichal improvementsinutilisationoftheczechnationalhpccenterbyatlasdistributedcomputing
AT chudobajiri improvementsinutilisationoftheczechnationalhpccenterbyatlasdistributedcomputing
AT vokacpetr improvementsinutilisationoftheczechnationalhpccenterbyatlasdistributedcomputing