Cargando…
Use ATLAS@home to exploit extra CPU from busy grid sites
Grid computing provides the main resource for data processing of High Energy Physics experiments, and a study we conducted shows that typical grid sites used by ATLAS computing are not fully utilized with the regular workloads. In order to increase the CPU utilization of these grid sites, we use ATL...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2018
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2650925 |
_version_ | 1780960840328937472 |
---|---|
author | The ATLAS collaboration |
author_facet | The ATLAS collaboration |
author_sort | The ATLAS collaboration |
collection | CERN |
description | Grid computing provides the main resource for data processing of High Energy Physics experiments, and a study we conducted shows that typical grid sites used by ATLAS computing are not fully utilized with the regular workloads. In order to increase the CPU utilization of these grid sites, we use ATLAS@Home jobs as back ll. The results show an extra 15% to 42% CPU can be exploited by the backfilling jobs while the grid sites are filled with regular workloads and the overall CPU utilization can remain over 90% for the sites. We also measure the impact on the grid jobs and the quality of exploited cputime in the backfi lling model. The measurements prove that the backfi lling model has no impact on the grid jobs regarding the failure rate of the grid jobs, and the impact on the CPU efficiency of grid jobs varies from 1% to 11% depending on the con figuration of the site. This is mainly linked to the memory usage of the grid jobs and the resource allocation policy of the site, and this is tunable from both the ATLAS@home and site's resource allocation policy. In addition the throughput of back ll jobs in terms of cputime per event simulated is the same as for resources dedicated to ATLAS@Home. We believe this approach is generic enough to be extended to other clusters. |
id | cern-2650925 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2018 |
record_format | invenio |
spelling | cern-26509252021-04-19T09:06:22Zhttp://cds.cern.ch/record/2650925engThe ATLAS collaborationUse ATLAS@home to exploit extra CPU from busy grid sitesParticle Physics - ExperimentGrid computing provides the main resource for data processing of High Energy Physics experiments, and a study we conducted shows that typical grid sites used by ATLAS computing are not fully utilized with the regular workloads. In order to increase the CPU utilization of these grid sites, we use ATLAS@Home jobs as back ll. The results show an extra 15% to 42% CPU can be exploited by the backfilling jobs while the grid sites are filled with regular workloads and the overall CPU utilization can remain over 90% for the sites. We also measure the impact on the grid jobs and the quality of exploited cputime in the backfi lling model. The measurements prove that the backfi lling model has no impact on the grid jobs regarding the failure rate of the grid jobs, and the impact on the CPU efficiency of grid jobs varies from 1% to 11% depending on the con figuration of the site. This is mainly linked to the memory usage of the grid jobs and the resource allocation policy of the site, and this is tunable from both the ATLAS@home and site's resource allocation policy. In addition the throughput of back ll jobs in terms of cputime per event simulated is the same as for resources dedicated to ATLAS@Home. We believe this approach is generic enough to be extended to other clusters.ATL-SOFT-PUB-2018-003oai:cds.cern.ch:26509252018-12-11 |
spellingShingle | Particle Physics - Experiment The ATLAS collaboration Use ATLAS@home to exploit extra CPU from busy grid sites |
title | Use ATLAS@home to exploit extra CPU from busy grid sites |
title_full | Use ATLAS@home to exploit extra CPU from busy grid sites |
title_fullStr | Use ATLAS@home to exploit extra CPU from busy grid sites |
title_full_unstemmed | Use ATLAS@home to exploit extra CPU from busy grid sites |
title_short | Use ATLAS@home to exploit extra CPU from busy grid sites |
title_sort | use atlas@home to exploit extra cpu from busy grid sites |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2650925 |
work_keys_str_mv | AT theatlascollaboration useatlashometoexploitextracpufrombusygridsites |