Cargando…
Grid production with the ATLAS Event Service
ATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such...
Autores principales: | , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2018
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/201921404016 http://cds.cern.ch/record/2649076 |
_version_ | 1780960713480601600 |
---|---|
author | Fullana Torregrosa, Esteban Benjamin, Douglas Calafiura, Paolo Childers, John Taylor De, Kaushik Di Girolamo, Alessandro García Navarro, José Enrique Guan, Wen Lassnig, Mario Maeno, Tadashi Nilsson, Paul Tsulaia, Vakhtang Van Gemmeren, Peter Wenaus, Torre Yang, Wei |
author_facet | Fullana Torregrosa, Esteban Benjamin, Douglas Calafiura, Paolo Childers, John Taylor De, Kaushik Di Girolamo, Alessandro García Navarro, José Enrique Guan, Wen Lassnig, Mario Maeno, Tadashi Nilsson, Paul Tsulaia, Vakhtang Van Gemmeren, Peter Wenaus, Torre Yang, Wei |
author_sort | Fullana Torregrosa, Esteban |
collection | CERN |
description | ATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such as commercial cloud, supercomputing, and volunteer computing, and otherwise unused cycles on clusters and grids. During the development and deployment phase, its utility also on the grid and conventional clusters for the exploitation of otherwise unused cycles became apparent. Here we describe our experience commissioning the Event Service on the grid in the ATLAS production system. We study the performance compared with standard simulation production. We describe the integration with the ATLAS data management system to ensure scalability and compatibility with object stores. Finally, we outline the remaining steps towards a fully commissioned system. |
id | cern-2649076 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2018 |
record_format | invenio |
spelling | cern-26490762022-08-10T12:24:18Zdoi:10.1051/epjconf/201921404016http://cds.cern.ch/record/2649076engFullana Torregrosa, EstebanBenjamin, DouglasCalafiura, PaoloChilders, John TaylorDe, KaushikDi Girolamo, AlessandroGarcía Navarro, José EnriqueGuan, WenLassnig, MarioMaeno, TadashiNilsson, PaulTsulaia, VakhtangVan Gemmeren, PeterWenaus, TorreYang, WeiGrid production with the ATLAS Event ServiceParticle Physics - ExperimentATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such as commercial cloud, supercomputing, and volunteer computing, and otherwise unused cycles on clusters and grids. During the development and deployment phase, its utility also on the grid and conventional clusters for the exploitation of otherwise unused cycles became apparent. Here we describe our experience commissioning the Event Service on the grid in the ATLAS production system. We study the performance compared with standard simulation production. We describe the integration with the ATLAS data management system to ensure scalability and compatibility with object stores. Finally, we outline the remaining steps towards a fully commissioned system.ATL-SOFT-PROC-2018-037oai:cds.cern.ch:26490762018-11-27 |
spellingShingle | Particle Physics - Experiment Fullana Torregrosa, Esteban Benjamin, Douglas Calafiura, Paolo Childers, John Taylor De, Kaushik Di Girolamo, Alessandro García Navarro, José Enrique Guan, Wen Lassnig, Mario Maeno, Tadashi Nilsson, Paul Tsulaia, Vakhtang Van Gemmeren, Peter Wenaus, Torre Yang, Wei Grid production with the ATLAS Event Service |
title | Grid production with the ATLAS Event Service |
title_full | Grid production with the ATLAS Event Service |
title_fullStr | Grid production with the ATLAS Event Service |
title_full_unstemmed | Grid production with the ATLAS Event Service |
title_short | Grid production with the ATLAS Event Service |
title_sort | grid production with the atlas event service |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1051/epjconf/201921404016 http://cds.cern.ch/record/2649076 |
work_keys_str_mv | AT fullanatorregrosaesteban gridproductionwiththeatlaseventservice AT benjamindouglas gridproductionwiththeatlaseventservice AT calafiurapaolo gridproductionwiththeatlaseventservice AT childersjohntaylor gridproductionwiththeatlaseventservice AT dekaushik gridproductionwiththeatlaseventservice AT digirolamoalessandro gridproductionwiththeatlaseventservice AT garcianavarrojoseenrique gridproductionwiththeatlaseventservice AT guanwen gridproductionwiththeatlaseventservice AT lassnigmario gridproductionwiththeatlaseventservice AT maenotadashi gridproductionwiththeatlaseventservice AT nilssonpaul gridproductionwiththeatlaseventservice AT tsulaiavakhtang gridproductionwiththeatlaseventservice AT vangemmerenpeter gridproductionwiththeatlaseventservice AT wenaustorre gridproductionwiththeatlaseventservice AT yangwei gridproductionwiththeatlaseventservice |