Cargando…
Grid production with the ATLAS Event Service
ATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such...
Autores principales: | , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2018
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2625059 |
_version_ | 1780958775576887296 |
---|---|
author | Benjamin, Douglas Calafiura, Paolo Childers, John Taylor De, Kaushik Fullana Torregrosa, Esteban Van Gemmeren, Peter Di Girolamo, Alessandro Guan, Wen Lassnig, Mario Maeno, Tadashi Nilsson, Paul Tsulaia, Vakhtang Wenaus, Torre Yang, Wei |
author_facet | Benjamin, Douglas Calafiura, Paolo Childers, John Taylor De, Kaushik Fullana Torregrosa, Esteban Van Gemmeren, Peter Di Girolamo, Alessandro Guan, Wen Lassnig, Mario Maeno, Tadashi Nilsson, Paul Tsulaia, Vakhtang Wenaus, Torre Yang, Wei |
author_sort | Benjamin, Douglas |
collection | CERN |
description | ATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such as commercial cloud, supercomputing, and volunteer computing, and otherwise unused cycles on clusters and grids. During the development and deployment phase, its utility also on the grid and conventional clusters for the exploitation of otherwise unused cycles became apparent. Here we describe our experience commissioning the Event Service on the grid in the ATLAS production system. We study the performance compared with standard simulation production. We describe the integration with the ATLAS data management system to ensure scalability and compatibility with object stores. Finally, we outline the remaining steps towards a fully commissioned system. |
id | cern-2625059 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2018 |
record_format | invenio |
spelling | cern-26250592019-11-04T10:14:43Zhttp://cds.cern.ch/record/2625059engBenjamin, DouglasCalafiura, PaoloChilders, John TaylorDe, KaushikFullana Torregrosa, EstebanVan Gemmeren, PeterDi Girolamo, AlessandroGuan, WenLassnig, MarioMaeno, TadashiNilsson, PaulTsulaia, VakhtangWenaus, TorreYang, WeiGrid production with the ATLAS Event ServiceParticle Physics - ExperimentATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such as commercial cloud, supercomputing, and volunteer computing, and otherwise unused cycles on clusters and grids. During the development and deployment phase, its utility also on the grid and conventional clusters for the exploitation of otherwise unused cycles became apparent. Here we describe our experience commissioning the Event Service on the grid in the ATLAS production system. We study the performance compared with standard simulation production. We describe the integration with the ATLAS data management system to ensure scalability and compatibility with object stores. Finally, we outline the remaining steps towards a fully commissioned system.ATL-SOFT-SLIDE-2018-385oai:cds.cern.ch:26250592018-06-20 |
spellingShingle | Particle Physics - Experiment Benjamin, Douglas Calafiura, Paolo Childers, John Taylor De, Kaushik Fullana Torregrosa, Esteban Van Gemmeren, Peter Di Girolamo, Alessandro Guan, Wen Lassnig, Mario Maeno, Tadashi Nilsson, Paul Tsulaia, Vakhtang Wenaus, Torre Yang, Wei Grid production with the ATLAS Event Service |
title | Grid production with the ATLAS Event Service |
title_full | Grid production with the ATLAS Event Service |
title_fullStr | Grid production with the ATLAS Event Service |
title_full_unstemmed | Grid production with the ATLAS Event Service |
title_short | Grid production with the ATLAS Event Service |
title_sort | grid production with the atlas event service |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2625059 |
work_keys_str_mv | AT benjamindouglas gridproductionwiththeatlaseventservice AT calafiurapaolo gridproductionwiththeatlaseventservice AT childersjohntaylor gridproductionwiththeatlaseventservice AT dekaushik gridproductionwiththeatlaseventservice AT fullanatorregrosaesteban gridproductionwiththeatlaseventservice AT vangemmerenpeter gridproductionwiththeatlaseventservice AT digirolamoalessandro gridproductionwiththeatlaseventservice AT guanwen gridproductionwiththeatlaseventservice AT lassnigmario gridproductionwiththeatlaseventservice AT maenotadashi gridproductionwiththeatlaseventservice AT nilssonpaul gridproductionwiththeatlaseventservice AT tsulaiavakhtang gridproductionwiththeatlaseventservice AT wenaustorre gridproductionwiththeatlaseventservice AT yangwei gridproductionwiththeatlaseventservice |