Cargando…

Design and evaluation of data quality control methods for a very high bandwidth data acquisition and processing system in the future CERN/ALICE O2 framework

Modern physics experiments acquire very large amounts of data which require diligent quality monitoring and assessment. Data Quality Monitoring (DQM) systems help with identifying problems with particle detectors, data transfer and initial processing, where timely and accurate feedback is crucial. T...

Descripción completa

Detalles Bibliográficos
Autor principal: Konopka, Piotr Jan
Lenguaje:eng
Publicado: 2022
Materias:
Acceso en línea:http://cds.cern.ch/record/2814071
_version_ 1780973431168172032
author Konopka, Piotr Jan
author_facet Konopka, Piotr Jan
author_sort Konopka, Piotr Jan
collection CERN
description Modern physics experiments acquire very large amounts of data which require diligent quality monitoring and assessment. Data Quality Monitoring (DQM) systems help with identifying problems with particle detectors, data transfer and initial processing, where timely and accurate feedback is crucial. They are complemented with Quality Assurance (QA) systems, which allow to perform extensive assessment of the data quality before preparing them for physical analyses. This dissertation covers the new data Quality Control (QC) framework for the upgraded ALICE experiment at the CERN LHC. Starting from the year 2022, the QC system will accompany the main computing software during the acquisition of a 3.5 TB/s raw data stream, its compression on-the-fly and final quality assessment. Thus, it combines the functionalities of DQM and QA within a complete system. The QC framework is a highly parallel system, which can split computations among thousands of nodes. According to the reviewed literature, it is the first system of this kind to rely fully on message-passing and the actor model. In the dissertation, its general design and components are presented, giving the most detail to those which required novel solutions. A mathematical model of two available variants for multinode QC setups is proposed. The framework benchmarks results are presented and discussed.
id cern-2814071
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2022
record_format invenio
spelling cern-28140712022-06-30T22:23:28Zhttp://cds.cern.ch/record/2814071engKonopka, Piotr JanDesign and evaluation of data quality control methods for a very high bandwidth data acquisition and processing system in the future CERN/ALICE O2 frameworkComputing and ComputersModern physics experiments acquire very large amounts of data which require diligent quality monitoring and assessment. Data Quality Monitoring (DQM) systems help with identifying problems with particle detectors, data transfer and initial processing, where timely and accurate feedback is crucial. They are complemented with Quality Assurance (QA) systems, which allow to perform extensive assessment of the data quality before preparing them for physical analyses. This dissertation covers the new data Quality Control (QC) framework for the upgraded ALICE experiment at the CERN LHC. Starting from the year 2022, the QC system will accompany the main computing software during the acquisition of a 3.5 TB/s raw data stream, its compression on-the-fly and final quality assessment. Thus, it combines the functionalities of DQM and QA within a complete system. The QC framework is a highly parallel system, which can split computations among thousands of nodes. According to the reviewed literature, it is the first system of this kind to rely fully on message-passing and the actor model. In the dissertation, its general design and components are presented, giving the most detail to those which required novel solutions. A mathematical model of two available variants for multinode QC setups is proposed. The framework benchmarks results are presented and discussed.CERN-THESIS-2021-335oai:cds.cern.ch:28140712022-06-29T22:19:17Z
spellingShingle Computing and Computers
Konopka, Piotr Jan
Design and evaluation of data quality control methods for a very high bandwidth data acquisition and processing system in the future CERN/ALICE O2 framework
title Design and evaluation of data quality control methods for a very high bandwidth data acquisition and processing system in the future CERN/ALICE O2 framework
title_full Design and evaluation of data quality control methods for a very high bandwidth data acquisition and processing system in the future CERN/ALICE O2 framework
title_fullStr Design and evaluation of data quality control methods for a very high bandwidth data acquisition and processing system in the future CERN/ALICE O2 framework
title_full_unstemmed Design and evaluation of data quality control methods for a very high bandwidth data acquisition and processing system in the future CERN/ALICE O2 framework
title_short Design and evaluation of data quality control methods for a very high bandwidth data acquisition and processing system in the future CERN/ALICE O2 framework
title_sort design and evaluation of data quality control methods for a very high bandwidth data acquisition and processing system in the future cern/alice o2 framework
topic Computing and Computers
url http://cds.cern.ch/record/2814071
work_keys_str_mv AT konopkapiotrjan designandevaluationofdataqualitycontrolmethodsforaveryhighbandwidthdataacquisitionandprocessingsysteminthefuturecernaliceo2framework