Cargando…

Grid production with the ATLAS Event Service

ATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such...

Descripción completa

Detalles Bibliográficos
Autores principales: Fullana Torregrosa, Esteban, Benjamin, Douglas, Calafiura, Paolo, Childers, John Taylor, De, Kaushik, Di Girolamo, Alessandro, García Navarro, José Enrique, Guan, Wen, Lassnig, Mario, Maeno, Tadashi, Nilsson, Paul, Tsulaia, Vakhtang, Van Gemmeren, Peter, Wenaus, Torre, Yang, Wei
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921404016
http://cds.cern.ch/record/2649076
_version_ 1780960713480601600
author Fullana Torregrosa, Esteban
Benjamin, Douglas
Calafiura, Paolo
Childers, John Taylor
De, Kaushik
Di Girolamo, Alessandro
García Navarro, José Enrique
Guan, Wen
Lassnig, Mario
Maeno, Tadashi
Nilsson, Paul
Tsulaia, Vakhtang
Van Gemmeren, Peter
Wenaus, Torre
Yang, Wei
author_facet Fullana Torregrosa, Esteban
Benjamin, Douglas
Calafiura, Paolo
Childers, John Taylor
De, Kaushik
Di Girolamo, Alessandro
García Navarro, José Enrique
Guan, Wen
Lassnig, Mario
Maeno, Tadashi
Nilsson, Paul
Tsulaia, Vakhtang
Van Gemmeren, Peter
Wenaus, Torre
Yang, Wei
author_sort Fullana Torregrosa, Esteban
collection CERN
description ATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such as commercial cloud, supercomputing, and volunteer computing, and otherwise unused cycles on clusters and grids. During the development and deployment phase, its utility also on the grid and conventional clusters for the exploitation of otherwise unused cycles became apparent. Here we describe our experience commissioning the Event Service on the grid in the ATLAS production system. We study the performance compared with standard simulation production. We describe the integration with the ATLAS data management system to ensure scalability and compatibility with object stores. Finally, we outline the remaining steps towards a fully commissioned system.
id cern-2649076
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26490762022-08-10T12:24:18Zdoi:10.1051/epjconf/201921404016http://cds.cern.ch/record/2649076engFullana Torregrosa, EstebanBenjamin, DouglasCalafiura, PaoloChilders, John TaylorDe, KaushikDi Girolamo, AlessandroGarcía Navarro, José EnriqueGuan, WenLassnig, MarioMaeno, TadashiNilsson, PaulTsulaia, VakhtangVan Gemmeren, PeterWenaus, TorreYang, WeiGrid production with the ATLAS Event ServiceParticle Physics - ExperimentATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such as commercial cloud, supercomputing, and volunteer computing, and otherwise unused cycles on clusters and grids. During the development and deployment phase, its utility also on the grid and conventional clusters for the exploitation of otherwise unused cycles became apparent. Here we describe our experience commissioning the Event Service on the grid in the ATLAS production system. We study the performance compared with standard simulation production. We describe the integration with the ATLAS data management system to ensure scalability and compatibility with object stores. Finally, we outline the remaining steps towards a fully commissioned system.ATL-SOFT-PROC-2018-037oai:cds.cern.ch:26490762018-11-27
spellingShingle Particle Physics - Experiment
Fullana Torregrosa, Esteban
Benjamin, Douglas
Calafiura, Paolo
Childers, John Taylor
De, Kaushik
Di Girolamo, Alessandro
García Navarro, José Enrique
Guan, Wen
Lassnig, Mario
Maeno, Tadashi
Nilsson, Paul
Tsulaia, Vakhtang
Van Gemmeren, Peter
Wenaus, Torre
Yang, Wei
Grid production with the ATLAS Event Service
title Grid production with the ATLAS Event Service
title_full Grid production with the ATLAS Event Service
title_fullStr Grid production with the ATLAS Event Service
title_full_unstemmed Grid production with the ATLAS Event Service
title_short Grid production with the ATLAS Event Service
title_sort grid production with the atlas event service
topic Particle Physics - Experiment
url https://dx.doi.org/10.1051/epjconf/201921404016
http://cds.cern.ch/record/2649076
work_keys_str_mv AT fullanatorregrosaesteban gridproductionwiththeatlaseventservice
AT benjamindouglas gridproductionwiththeatlaseventservice
AT calafiurapaolo gridproductionwiththeatlaseventservice
AT childersjohntaylor gridproductionwiththeatlaseventservice
AT dekaushik gridproductionwiththeatlaseventservice
AT digirolamoalessandro gridproductionwiththeatlaseventservice
AT garcianavarrojoseenrique gridproductionwiththeatlaseventservice
AT guanwen gridproductionwiththeatlaseventservice
AT lassnigmario gridproductionwiththeatlaseventservice
AT maenotadashi gridproductionwiththeatlaseventservice
AT nilssonpaul gridproductionwiththeatlaseventservice
AT tsulaiavakhtang gridproductionwiththeatlaseventservice
AT vangemmerenpeter gridproductionwiththeatlaseventservice
AT wenaustorre gridproductionwiththeatlaseventservice
AT yangwei gridproductionwiththeatlaseventservice