Cargando…

Optimizing access to conditions data in ATLAS event data processing

The processing of ATLAS event data requires access to conditions data which is stored in database systems. This data includes, for example alignment, calibration, and configuration information which may be characterized by large volumes, diverse content, and/or information which evolves over time as...

Descripción completa

Detalles Bibliográficos
Autores principales: Rinaldi, Lorenzo, Gallas, Elizabeth, Formica, Andrea
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921404051
http://cds.cern.ch/record/2649255
_version_ 1780960725385084928
author Rinaldi, Lorenzo
Gallas, Elizabeth
Formica, Andrea
author_facet Rinaldi, Lorenzo
Gallas, Elizabeth
Formica, Andrea
author_sort Rinaldi, Lorenzo
collection CERN
description The processing of ATLAS event data requires access to conditions data which is stored in database systems. This data includes, for example alignment, calibration, and configuration information which may be characterized by large volumes, diverse content, and/or information which evolves over time as refinements are made in those conditions. Additional layers of complexity are added by the need to provide this information across the worldwide ATLAS computing grid and the sheer number of simultaneously executing processes on the grid, each demanding a unique set of conditions to proceed. Distributing this data to all the processes that require it in an efficient manner has proven to be an increasing challenge with the growing needs and numbers of event-wise tasks. In this presentation, we briefly describe the systems in which we have collected information about the database content and the use of conditions in event data processing. We then proceed to explain how this information has been used not only to refine reconstruction software and job configuration but also to guide modifications of underlying conditions data configuration and in some cases, rewrites of the data in the database into a more harmonious form for offline usage in the processing of both real and simulated data.
id cern-2649255
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26492552022-01-14T15:04:02Zdoi:10.1051/epjconf/201921404051http://cds.cern.ch/record/2649255engRinaldi, LorenzoGallas, ElizabethFormica, AndreaOptimizing access to conditions data in ATLAS event data processingParticle Physics - ExperimentThe processing of ATLAS event data requires access to conditions data which is stored in database systems. This data includes, for example alignment, calibration, and configuration information which may be characterized by large volumes, diverse content, and/or information which evolves over time as refinements are made in those conditions. Additional layers of complexity are added by the need to provide this information across the worldwide ATLAS computing grid and the sheer number of simultaneously executing processes on the grid, each demanding a unique set of conditions to proceed. Distributing this data to all the processes that require it in an efficient manner has proven to be an increasing challenge with the growing needs and numbers of event-wise tasks. In this presentation, we briefly describe the systems in which we have collected information about the database content and the use of conditions in event data processing. We then proceed to explain how this information has been used not only to refine reconstruction software and job configuration but also to guide modifications of underlying conditions data configuration and in some cases, rewrites of the data in the database into a more harmonious form for offline usage in the processing of both real and simulated data.ATL-SOFT-PROC-2018-042oai:cds.cern.ch:26492552018-11-28
spellingShingle Particle Physics - Experiment
Rinaldi, Lorenzo
Gallas, Elizabeth
Formica, Andrea
Optimizing access to conditions data in ATLAS event data processing
title Optimizing access to conditions data in ATLAS event data processing
title_full Optimizing access to conditions data in ATLAS event data processing
title_fullStr Optimizing access to conditions data in ATLAS event data processing
title_full_unstemmed Optimizing access to conditions data in ATLAS event data processing
title_short Optimizing access to conditions data in ATLAS event data processing
title_sort optimizing access to conditions data in atlas event data processing
topic Particle Physics - Experiment
url https://dx.doi.org/10.1051/epjconf/201921404051
http://cds.cern.ch/record/2649255
work_keys_str_mv AT rinaldilorenzo optimizingaccesstoconditionsdatainatlaseventdataprocessing
AT gallaselizabeth optimizingaccesstoconditionsdatainatlaseventdataprocessing
AT formicaandrea optimizingaccesstoconditionsdatainatlaseventdataprocessing