Cargando…

Use ATLAS@home to exploit extra CPU from busy grid sites

Grid computing provides the main resource for data processing of High Energy Physics experiments, and a study we conducted shows that typical grid sites used by ATLAS computing are not fully utilized with the regular workloads. In order to increase the CPU utilization of these grid sites, we use ATL...

Descripción completa

Detalles Bibliográficos
Autor principal: The ATLAS collaboration
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:http://cds.cern.ch/record/2650925
_version_ 1780960840328937472
author The ATLAS collaboration
author_facet The ATLAS collaboration
author_sort The ATLAS collaboration
collection CERN
description Grid computing provides the main resource for data processing of High Energy Physics experiments, and a study we conducted shows that typical grid sites used by ATLAS computing are not fully utilized with the regular workloads. In order to increase the CPU utilization of these grid sites, we use ATLAS@Home jobs as back ll. The results show an extra 15% to 42% CPU can be exploited by the backfilling jobs while the grid sites are filled with regular workloads and the overall CPU utilization can remain over 90% for the sites. We also measure the impact on the grid jobs and the quality of exploited cputime in the backfi lling model. The measurements prove that the backfi lling model has no impact on the grid jobs regarding the failure rate of the grid jobs, and the impact on the CPU efficiency of grid jobs varies from 1% to 11% depending on the con figuration of the site. This is mainly linked to the memory usage of the grid jobs and the resource allocation policy of the site, and this is tunable from both the ATLAS@home and site's resource allocation policy. In addition the throughput of back ll jobs in terms of cputime per event simulated is the same as for resources dedicated to ATLAS@Home. We believe this approach is generic enough to be extended to other clusters.
id cern-2650925
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26509252021-04-19T09:06:22Zhttp://cds.cern.ch/record/2650925engThe ATLAS collaborationUse ATLAS@home to exploit extra CPU from busy grid sitesParticle Physics - ExperimentGrid computing provides the main resource for data processing of High Energy Physics experiments, and a study we conducted shows that typical grid sites used by ATLAS computing are not fully utilized with the regular workloads. In order to increase the CPU utilization of these grid sites, we use ATLAS@Home jobs as back ll. The results show an extra 15% to 42% CPU can be exploited by the backfilling jobs while the grid sites are filled with regular workloads and the overall CPU utilization can remain over 90% for the sites. We also measure the impact on the grid jobs and the quality of exploited cputime in the backfi lling model. The measurements prove that the backfi lling model has no impact on the grid jobs regarding the failure rate of the grid jobs, and the impact on the CPU efficiency of grid jobs varies from 1% to 11% depending on the con figuration of the site. This is mainly linked to the memory usage of the grid jobs and the resource allocation policy of the site, and this is tunable from both the ATLAS@home and site's resource allocation policy. In addition the throughput of back ll jobs in terms of cputime per event simulated is the same as for resources dedicated to ATLAS@Home. We believe this approach is generic enough to be extended to other clusters.ATL-SOFT-PUB-2018-003oai:cds.cern.ch:26509252018-12-11
spellingShingle Particle Physics - Experiment
The ATLAS collaboration
Use ATLAS@home to exploit extra CPU from busy grid sites
title Use ATLAS@home to exploit extra CPU from busy grid sites
title_full Use ATLAS@home to exploit extra CPU from busy grid sites
title_fullStr Use ATLAS@home to exploit extra CPU from busy grid sites
title_full_unstemmed Use ATLAS@home to exploit extra CPU from busy grid sites
title_short Use ATLAS@home to exploit extra CPU from busy grid sites
title_sort use atlas@home to exploit extra cpu from busy grid sites
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2650925
work_keys_str_mv AT theatlascollaboration useatlashometoexploitextracpufrombusygridsites