Cargando…

A Python object-oriented framework for the CMS alignment and calibration data

The Alignment, Calibrations and Databases group at the CMS Experiment delivers Alignment and Calibration Conditions Data to a large set of workflows which process recorded event data and produce simulated events. The current infrastructure for releasing and consuming Conditions Data was designed in...

Descripción completa

Detalles Bibliográficos
Autor principal: Dawes, Joshua Heneage
Lenguaje:eng
Publicado: 2017
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/898/4/042059
http://cds.cern.ch/record/2253529
_version_ 1780953561726713856
author Dawes, Joshua Heneage
author_facet Dawes, Joshua Heneage
author_sort Dawes, Joshua Heneage
collection CERN
description The Alignment, Calibrations and Databases group at the CMS Experiment delivers Alignment and Calibration Conditions Data to a large set of workflows which process recorded event data and produce simulated events. The current infrastructure for releasing and consuming Conditions Data was designed in the two years of the first LHC long shutdown to respond to use cases from the preceding data-taking period. During the second run of the LHC, new use cases were defined. For the consumption of Conditions Metadata, no common interface existed for the detector experts to use in Python-based custom scripts, resulting in many different querying and transaction management patterns. A new framework has been built to address such use cases: a simple object-oriented tool that detector experts can use to read and write Conditions Metadata when using Oracle and SQLite databases, that provides a homogeneous method of querying across all services. The tool provides mechanisms for segmenting large sets of conditions while releasing them to the production database, allows for uniform error reporting to the client-side from the server-side and optimizes the data transfer to the server. The architecture of the new service has been developed exploiting many of the features made available by the metadata consumption framework to implement the required improvements. This paper presents the details of the design and implementation of the new metadata consumption and data upload framework, as well as analyses of the new upload service’s performance as the server-side state varies.
id cern-2253529
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2017
record_format invenio
spelling cern-22535292019-10-15T15:17:35Zdoi:10.1088/1742-6596/898/4/042059http://cds.cern.ch/record/2253529engDawes, Joshua HeneageA Python object-oriented framework for the CMS alignment and calibration dataDetectors and Experimental TechniquesThe Alignment, Calibrations and Databases group at the CMS Experiment delivers Alignment and Calibration Conditions Data to a large set of workflows which process recorded event data and produce simulated events. The current infrastructure for releasing and consuming Conditions Data was designed in the two years of the first LHC long shutdown to respond to use cases from the preceding data-taking period. During the second run of the LHC, new use cases were defined. For the consumption of Conditions Metadata, no common interface existed for the detector experts to use in Python-based custom scripts, resulting in many different querying and transaction management patterns. A new framework has been built to address such use cases: a simple object-oriented tool that detector experts can use to read and write Conditions Metadata when using Oracle and SQLite databases, that provides a homogeneous method of querying across all services. The tool provides mechanisms for segmenting large sets of conditions while releasing them to the production database, allows for uniform error reporting to the client-side from the server-side and optimizes the data transfer to the server. The architecture of the new service has been developed exploiting many of the features made available by the metadata consumption framework to implement the required improvements. This paper presents the details of the design and implementation of the new metadata consumption and data upload framework, as well as analyses of the new upload service’s performance as the server-side state varies.CMS-CR-2017-042oai:cds.cern.ch:22535292017-02-17
spellingShingle Detectors and Experimental Techniques
Dawes, Joshua Heneage
A Python object-oriented framework for the CMS alignment and calibration data
title A Python object-oriented framework for the CMS alignment and calibration data
title_full A Python object-oriented framework for the CMS alignment and calibration data
title_fullStr A Python object-oriented framework for the CMS alignment and calibration data
title_full_unstemmed A Python object-oriented framework for the CMS alignment and calibration data
title_short A Python object-oriented framework for the CMS alignment and calibration data
title_sort python object-oriented framework for the cms alignment and calibration data
topic Detectors and Experimental Techniques
url https://dx.doi.org/10.1088/1742-6596/898/4/042059
http://cds.cern.ch/record/2253529
work_keys_str_mv AT dawesjoshuaheneage apythonobjectorientedframeworkforthecmsalignmentandcalibrationdata
AT dawesjoshuaheneage pythonobjectorientedframeworkforthecmsalignmentandcalibrationdata