Cargando…

Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service

With ever-greater computing needs and fixed budgets, big scientific experiments are turning to opportunistic resources as a means to add much-needed extra computing power. These resources can be very different in design from the resources that comprise the Grid computing of most experiments, therefo...

Descripción completa

Detalles Bibliográficos
Autores principales: Cameron, David, Filipčič, Andrej, Guan, Wen, Tsulaia, Vakhtang, Walker, Rodney, Wenaus, Torre
Lenguaje:eng
Publicado: 2017
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/898/5/052010
http://cds.cern.ch/record/2241360
_version_ 1780953191787003904
author Cameron, David
Filipčič, Andrej
Guan, Wen
Tsulaia, Vakhtang
Walker, Rodney
Wenaus, Torre
author_facet Cameron, David
Filipčič, Andrej
Guan, Wen
Tsulaia, Vakhtang
Walker, Rodney
Wenaus, Torre
author_sort Cameron, David
collection CERN
description With ever-greater computing needs and fixed budgets, big scientific experiments are turning to opportunistic resources as a means to add much-needed extra computing power. These resources can be very different in design from the resources that comprise the Grid computing of most experiments, therefore exploiting these resources requires a change in strategy for the experiment. The resources may be highly restrictive in what can be run or in connections to the outside world, or tolerate opportunistic usage only on condition that tasks may be terminated without warning. The ARC CE with its non-intrusive architecture is designed to integrate resources such as High Performance Computing (HPC) systems into a computing Grid. The ATLAS experiment developed the Event Service primarily to address the issue of jobs that can be terminated at any point when opportunistic resources are needed by someone else. This paper describes the integration of these two systems in order to exploit opportunistic resources for ATLAS in a restrictive environment. In addition to the technical details, results from deployment of this solution in the SuperMUC HPC in Munich are shown.
id cern-2241360
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2017
record_format invenio
spelling cern-22413602019-10-15T15:17:51Zdoi:10.1088/1742-6596/898/5/052010http://cds.cern.ch/record/2241360engCameron, DavidFilipčič, AndrejGuan, WenTsulaia, VakhtangWalker, RodneyWenaus, TorreExploiting opportunistic resources for ATLAS with ARC CE and the Event ServiceParticle Physics - ExperimentWith ever-greater computing needs and fixed budgets, big scientific experiments are turning to opportunistic resources as a means to add much-needed extra computing power. These resources can be very different in design from the resources that comprise the Grid computing of most experiments, therefore exploiting these resources requires a change in strategy for the experiment. The resources may be highly restrictive in what can be run or in connections to the outside world, or tolerate opportunistic usage only on condition that tasks may be terminated without warning. The ARC CE with its non-intrusive architecture is designed to integrate resources such as High Performance Computing (HPC) systems into a computing Grid. The ATLAS experiment developed the Event Service primarily to address the issue of jobs that can be terminated at any point when opportunistic resources are needed by someone else. This paper describes the integration of these two systems in order to exploit opportunistic resources for ATLAS in a restrictive environment. In addition to the technical details, results from deployment of this solution in the SuperMUC HPC in Munich are shown.With ever-greater computing needs and fixed budgets, big scientific experiments are turning to opportunistic resources as a means to add much-needed extra computing power. These resources can be very different in design from those that comprise the Grid computing of most experiments, therefore exploiting them requires a change in strategy for the experiment. They may be highly restrictive in what can be run or in connections to the outside world, or tolerate opportunistic usage only on condition that tasks may be terminated without warning. The Advanced Resource Connector Computing Element (ARC CE) with its nonintrusive architecture is designed to integrate resources such as High Performance Computing (HPC) systems into a computing Grid. The ATLAS experiment developed the ATLAS Event Service (AES) primarily to address the issue of jobs that can be terminated at any point when opportunistic computing capacity is needed by someone else. This paper describes the integration of these two systems in order to exploit opportunistic resources for ATLAS in a restrictive environment. In addition to the technical details, results from deployment of this solution in the SuperMUC HPC centre in Munich are shown.ATL-SOFT-PROC-2017-013oai:cds.cern.ch:22413602017-01-12
spellingShingle Particle Physics - Experiment
Cameron, David
Filipčič, Andrej
Guan, Wen
Tsulaia, Vakhtang
Walker, Rodney
Wenaus, Torre
Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service
title Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service
title_full Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service
title_fullStr Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service
title_full_unstemmed Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service
title_short Exploiting opportunistic resources for ATLAS with ARC CE and the Event Service
title_sort exploiting opportunistic resources for atlas with arc ce and the event service
topic Particle Physics - Experiment
url https://dx.doi.org/10.1088/1742-6596/898/5/052010
http://cds.cern.ch/record/2241360
work_keys_str_mv AT camerondavid exploitingopportunisticresourcesforatlaswitharcceandtheeventservice
AT filipcicandrej exploitingopportunisticresourcesforatlaswitharcceandtheeventservice
AT guanwen exploitingopportunisticresourcesforatlaswitharcceandtheeventservice
AT tsulaiavakhtang exploitingopportunisticresourcesforatlaswitharcceandtheeventservice
AT walkerrodney exploitingopportunisticresourcesforatlaswitharcceandtheeventservice
AT wenaustorre exploitingopportunisticresourcesforatlaswitharcceandtheeventservice