Cargando…
Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service
With ever-greater computing needs and fixed budgets, big scientific experiments are turning to opportunistic resources as a means to add much-needed extra computing power. These resources can be very different in design from the resources that comprise the Grid computing of most experiments, therefo...
Autores principales: | , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2017
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/898/5/052010 http://cds.cern.ch/record/2241360 |
_version_ | 1780953191787003904 |
---|---|
author | Cameron, David Filipčič, Andrej Guan, Wen Tsulaia, Vakhtang Walker, Rodney Wenaus, Torre |
author_facet | Cameron, David Filipčič, Andrej Guan, Wen Tsulaia, Vakhtang Walker, Rodney Wenaus, Torre |
author_sort | Cameron, David |
collection | CERN |
description | With ever-greater computing needs and fixed budgets, big scientific experiments are turning to opportunistic resources as a means to add much-needed extra computing power. These resources can be very different in design from the resources that comprise the Grid computing of most experiments, therefore exploiting these resources requires a change in strategy for the experiment. The resources may be highly restrictive in what can be run or in connections to the outside world, or tolerate opportunistic usage only on condition that tasks may be terminated without warning. The ARC CE with its non-intrusive architecture is designed to integrate resources such as High Performance Computing (HPC) systems into a computing Grid. The ATLAS experiment developed the Event Service primarily to address the issue of jobs that can be terminated at any point when opportunistic resources are needed by someone else. This paper describes the integration of these two systems in order to exploit opportunistic resources for ATLAS in a restrictive environment. In addition to the technical details, results from deployment of this solution in the SuperMUC HPC in Munich are shown. |
id | cern-2241360 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2017 |
record_format | invenio |
spelling | cern-22413602019-10-15T15:17:51Zdoi:10.1088/1742-6596/898/5/052010http://cds.cern.ch/record/2241360engCameron, DavidFilipčič, AndrejGuan, WenTsulaia, VakhtangWalker, RodneyWenaus, TorreExploiting opportunistic resources for ATLAS with ARC CE and the Event ServiceParticle Physics - ExperimentWith ever-greater computing needs and fixed budgets, big scientific experiments are turning to opportunistic resources as a means to add much-needed extra computing power. These resources can be very different in design from the resources that comprise the Grid computing of most experiments, therefore exploiting these resources requires a change in strategy for the experiment. The resources may be highly restrictive in what can be run or in connections to the outside world, or tolerate opportunistic usage only on condition that tasks may be terminated without warning. The ARC CE with its non-intrusive architecture is designed to integrate resources such as High Performance Computing (HPC) systems into a computing Grid. The ATLAS experiment developed the Event Service primarily to address the issue of jobs that can be terminated at any point when opportunistic resources are needed by someone else. This paper describes the integration of these two systems in order to exploit opportunistic resources for ATLAS in a restrictive environment. In addition to the technical details, results from deployment of this solution in the SuperMUC HPC in Munich are shown.With ever-greater computing needs and fixed budgets, big scientific experiments are turning to opportunistic resources as a means to add much-needed extra computing power. These resources can be very different in design from those that comprise the Grid computing of most experiments, therefore exploiting them requires a change in strategy for the experiment. They may be highly restrictive in what can be run or in connections to the outside world, or tolerate opportunistic usage only on condition that tasks may be terminated without warning. The Advanced Resource Connector Computing Element (ARC CE) with its nonintrusive architecture is designed to integrate resources such as High Performance Computing (HPC) systems into a computing Grid. The ATLAS experiment developed the ATLAS Event Service (AES) primarily to address the issue of jobs that can be terminated at any point when opportunistic computing capacity is needed by someone else. This paper describes the integration of these two systems in order to exploit opportunistic resources for ATLAS in a restrictive environment. In addition to the technical details, results from deployment of this solution in the SuperMUC HPC centre in Munich are shown.ATL-SOFT-PROC-2017-013oai:cds.cern.ch:22413602017-01-12 |
spellingShingle | Particle Physics - Experiment Cameron, David Filipčič, Andrej Guan, Wen Tsulaia, Vakhtang Walker, Rodney Wenaus, Torre Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service |
title | Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service |
title_full | Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service |
title_fullStr | Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service |
title_full_unstemmed | Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service |
title_short | Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service |
title_sort | exploiting opportunistic resources for atlas with arc ce and the event service |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1088/1742-6596/898/5/052010 http://cds.cern.ch/record/2241360 |
work_keys_str_mv | AT camerondavid exploitingopportunisticresourcesforatlaswitharcceandtheeventservice AT filipcicandrej exploitingopportunisticresourcesforatlaswitharcceandtheeventservice AT guanwen exploitingopportunisticresourcesforatlaswitharcceandtheeventservice AT tsulaiavakhtang exploitingopportunisticresourcesforatlaswitharcceandtheeventservice AT walkerrodney exploitingopportunisticresourcesforatlaswitharcceandtheeventservice AT wenaustorre exploitingopportunisticresourcesforatlaswitharcceandtheeventservice |