Scaling up ATLAS Event Service to production levels on opportunistic computing platforms

Mostrar otras versiones (1)

Continued growth in public cloud and HPC resources is on track to overcome the dedicated resources available for ATLAS on the WLCG. Example of such platforms are Amazon AWS EC2 Spot Instances, Edison Cray XC30 supercomputer, backfill at the Tier-2 and Tier-3 sites, opportunistic resources at the Ope...

Descripción completa

Detalles Bibliográficos
Autores principales: Benjamin, Douglas, Caballero, Jose, Ernst, Michael, Guan, Wen, Hover, John, Lesny, David, Maeno, Tadashi, Nilsson, Paul, Tsulaia, Vakhtang, van Gemmeren, Peter, Vaniachine, Alexandre, Wang, Fuquan, Wenaus, Torre
Lenguaje:eng
Publicado: 2016
Materias:
Particle Physics - Experiment
Acceso en línea:http://cds.cern.ch/record/2120732
_version_ 1780949343124062208
author Benjamin, Douglas
Caballero, Jose
Ernst, Michael
Guan, Wen
Hover, John
Lesny, David
Maeno, Tadashi
Nilsson, Paul
Tsulaia, Vakhtang
van Gemmeren, Peter
Vaniachine, Alexandre
Wang, Fuquan
Wenaus, Torre
author_facet Benjamin, Douglas
Caballero, Jose
Ernst, Michael
Guan, Wen
Hover, John
Lesny, David
Maeno, Tadashi
Nilsson, Paul
Tsulaia, Vakhtang
van Gemmeren, Peter
Vaniachine, Alexandre
Wang, Fuquan
Wenaus, Torre
author_sort Benjamin, Douglas
collection CERN
description Continued growth in public cloud and HPC resources is on track to overcome the dedicated resources available for ATLAS on the WLCG. Example of such platforms are Amazon AWS EC2 Spot Instances, Edison Cray XC30 supercomputer, backfill at the Tier-2 and Tier-3 sites, opportunistic resources at the Open Science Grid, and ATLAS High Level Trigger farm between the data taking periods. Because of opportunistic resources specifics such as preemptive job scheduling and data I/O, their efficient usage requires workflow innovations provided by the ATLAS Event Service. Thanks to the finer granularity of the Event Service data processing workflow, the opportunistic resources are used more efficiently. We report on our progress in scaling opportunistic resource usage to double-digit levels in ATLAS production.
id cern-2120732
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2016
record_format invenio
spelling cern-21207322019-09-30T06:29:59Zhttp://cds.cern.ch/record/2120732engBenjamin, DouglasCaballero, JoseErnst, MichaelGuan, WenHover, JohnLesny, DavidMaeno, TadashiNilsson, PaulTsulaia, Vakhtangvan Gemmeren, PeterVaniachine, AlexandreWang, FuquanWenaus, TorreScaling up ATLAS Event Service to production levels on opportunistic computing platformsParticle Physics - ExperimentContinued growth in public cloud and HPC resources is on track to overcome the dedicated resources available for ATLAS on the WLCG. Example of such platforms are Amazon AWS EC2 Spot Instances, Edison Cray XC30 supercomputer, backfill at the Tier-2 and Tier-3 sites, opportunistic resources at the Open Science Grid, and ATLAS High Level Trigger farm between the data taking periods. Because of opportunistic resources specifics such as preemptive job scheduling and data I/O, their efficient usage requires workflow innovations provided by the ATLAS Event Service. Thanks to the finer granularity of the Event Service data processing workflow, the opportunistic resources are used more efficiently. We report on our progress in scaling opportunistic resource usage to double-digit levels in ATLAS production.ATL-SOFT-SLIDE-2016-012oai:cds.cern.ch:21207322016-01-12
spellingShingle Particle Physics - Experiment
Benjamin, Douglas
Caballero, Jose
Ernst, Michael
Guan, Wen
Hover, John
Lesny, David
Maeno, Tadashi
Nilsson, Paul
Tsulaia, Vakhtang
van Gemmeren, Peter
Vaniachine, Alexandre
Wang, Fuquan
Wenaus, Torre
Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
title Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
title_full Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
title_fullStr Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
title_full_unstemmed Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
title_short Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
title_sort scaling up atlas event service to production levels on opportunistic computing platforms
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2120732
work_keys_str_mv AT benjamindouglas scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT caballerojose scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT ernstmichael scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT guanwen scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT hoverjohn scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT lesnydavid scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT maenotadashi scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT nilssonpaul scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT tsulaiavakhtang scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT vangemmerenpeter scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT vaniachinealexandre scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT wangfuquan scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms
AT wenaustorre scalingupatlaseventservicetoproductionlevelsonopportunisticcomputingplatforms

Ejemplares similares