Cargando…
Optimizing access to conditions data in ATLAS event data processing
The processing of ATLAS event data requires access to conditions data which is stored in database systems. This data includes, for example alignment, calibration, and configuration information that may be characterized by large volumes, diverse content, and/or information which evolves over time as...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2018
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2626992 |
_version_ | 1780958934663692288 |
---|---|
author | Rinaldi, Lorenzo Gallas, Elizabeth Formica, Andrea |
author_facet | Rinaldi, Lorenzo Gallas, Elizabeth Formica, Andrea |
author_sort | Rinaldi, Lorenzo |
collection | CERN |
description | The processing of ATLAS event data requires access to conditions data which is stored in database systems. This data includes, for example alignment, calibration, and configuration information that may be characterized by large volumes, diverse content, and/or information which evolves over time as refinements are made in those conditions. Additional layers of complexity are added by the need to provide this information across the world-wide ATLAS computing grid and the sheer number of simultaneously executing processes on the grid, each demanding a unique set of conditions to proceed. Distributing this data to all the processes that require it in an efficient manner has proven to be an increasing challenge with the growing needs and number of event-wise tasks. In this presentation, we briefly describe the systems in which we have collected information about the use of conditions in event data processing. We then proceed to explain how this information has been used to refine not only reconstruction software and job configuration but also by modifying underlying conditions data configuration and in some cases, rewriting the data in the database into a more harmonious form for offline usage in the processing of both real and simulated data. |
id | cern-2626992 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2018 |
record_format | invenio |
spelling | cern-26269922020-08-20T10:45:16Zhttp://cds.cern.ch/record/2626992engRinaldi, LorenzoGallas, ElizabethFormica, AndreaOptimizing access to conditions data in ATLAS event data processingParticle Physics - ExperimentThe processing of ATLAS event data requires access to conditions data which is stored in database systems. This data includes, for example alignment, calibration, and configuration information that may be characterized by large volumes, diverse content, and/or information which evolves over time as refinements are made in those conditions. Additional layers of complexity are added by the need to provide this information across the world-wide ATLAS computing grid and the sheer number of simultaneously executing processes on the grid, each demanding a unique set of conditions to proceed. Distributing this data to all the processes that require it in an efficient manner has proven to be an increasing challenge with the growing needs and number of event-wise tasks. In this presentation, we briefly describe the systems in which we have collected information about the use of conditions in event data processing. We then proceed to explain how this information has been used to refine not only reconstruction software and job configuration but also by modifying underlying conditions data configuration and in some cases, rewriting the data in the database into a more harmonious form for offline usage in the processing of both real and simulated data.ATL-SOFT-SLIDE-2018-415oai:cds.cern.ch:26269922018-06-28 |
spellingShingle | Particle Physics - Experiment Rinaldi, Lorenzo Gallas, Elizabeth Formica, Andrea Optimizing access to conditions data in ATLAS event data processing |
title | Optimizing access to conditions data in ATLAS event data processing |
title_full | Optimizing access to conditions data in ATLAS event data processing |
title_fullStr | Optimizing access to conditions data in ATLAS event data processing |
title_full_unstemmed | Optimizing access to conditions data in ATLAS event data processing |
title_short | Optimizing access to conditions data in ATLAS event data processing |
title_sort | optimizing access to conditions data in atlas event data processing |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2626992 |
work_keys_str_mv | AT rinaldilorenzo optimizingaccesstoconditionsdatainatlaseventdataprocessing AT gallaselizabeth optimizingaccesstoconditionsdatainatlaseventdataprocessing AT formicaandrea optimizingaccesstoconditionsdatainatlaseventdataprocessing |