Cargando…

Optimizing access to conditions data in ATLAS event data processing

The processing of ATLAS event data requires access to conditions data which is stored in database systems. This data includes, for example alignment, calibration, and configuration information that may be characterized by large volumes, diverse content, and/or information which evolves over time as...

Descripción completa

Detalles Bibliográficos
Autores principales: Rinaldi, Lorenzo, Gallas, Elizabeth, Formica, Andrea
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:http://cds.cern.ch/record/2626992
_version_ 1780958934663692288
author Rinaldi, Lorenzo
Gallas, Elizabeth
Formica, Andrea
author_facet Rinaldi, Lorenzo
Gallas, Elizabeth
Formica, Andrea
author_sort Rinaldi, Lorenzo
collection CERN
description The processing of ATLAS event data requires access to conditions data which is stored in database systems. This data includes, for example alignment, calibration, and configuration information that may be characterized by large volumes, diverse content, and/or information which evolves over time as refinements are made in those conditions. Additional layers of complexity are added by the need to provide this information across the world-wide ATLAS computing grid and the sheer number of simultaneously executing processes on the grid, each demanding a unique set of conditions to proceed. Distributing this data to all the processes that require it in an efficient manner has proven to be an increasing challenge with the growing needs and number of event-wise tasks. In this presentation, we briefly describe the systems in which we have collected information about the use of conditions in event data processing. We then proceed to explain how this information has been used to refine not only reconstruction software and job configuration but also by modifying underlying conditions data configuration and in some cases, rewriting the data in the database into a more harmonious form for offline usage in the processing of both real and simulated data.
id cern-2626992
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26269922020-08-20T10:45:16Zhttp://cds.cern.ch/record/2626992engRinaldi, LorenzoGallas, ElizabethFormica, AndreaOptimizing access to conditions data in ATLAS event data processingParticle Physics - ExperimentThe processing of ATLAS event data requires access to conditions data which is stored in database systems. This data includes, for example alignment, calibration, and configuration information that may be characterized by large volumes, diverse content, and/or information which evolves over time as refinements are made in those conditions. Additional layers of complexity are added by the need to provide this information across the world-wide ATLAS computing grid and the sheer number of simultaneously executing processes on the grid, each demanding a unique set of conditions to proceed. Distributing this data to all the processes that require it in an efficient manner has proven to be an increasing challenge with the growing needs and number of event-wise tasks. In this presentation, we briefly describe the systems in which we have collected information about the use of conditions in event data processing. We then proceed to explain how this information has been used to refine not only reconstruction software and job configuration but also by modifying underlying conditions data configuration and in some cases, rewriting the data in the database into a more harmonious form for offline usage in the processing of both real and simulated data.ATL-SOFT-SLIDE-2018-415oai:cds.cern.ch:26269922018-06-28
spellingShingle Particle Physics - Experiment
Rinaldi, Lorenzo
Gallas, Elizabeth
Formica, Andrea
Optimizing access to conditions data in ATLAS event data processing
title Optimizing access to conditions data in ATLAS event data processing
title_full Optimizing access to conditions data in ATLAS event data processing
title_fullStr Optimizing access to conditions data in ATLAS event data processing
title_full_unstemmed Optimizing access to conditions data in ATLAS event data processing
title_short Optimizing access to conditions data in ATLAS event data processing
title_sort optimizing access to conditions data in atlas event data processing
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2626992
work_keys_str_mv AT rinaldilorenzo optimizingaccesstoconditionsdatainatlaseventdataprocessing
AT gallaselizabeth optimizingaccesstoconditionsdatainatlaseventdataprocessing
AT formicaandrea optimizingaccesstoconditionsdatainatlaseventdataprocessing