Cargando…

ATLAS Data Preparation in Run 2

In this presentation, the data preparation workflows for Run 2 are presented. Online data quality uses a new hybrid software release that incorporates the latest offline data quality monitoring software for the online environment. This is used to provide fast feedback in the control room during a da...

Descripción completa

Detalles Bibliográficos
Autor principal: Laycock, Paul
Lenguaje:eng
Publicado: 2016
Materias:
Acceso en línea:http://cds.cern.ch/record/2221220
_version_ 1780952234848157696
author Laycock, Paul
author_facet Laycock, Paul
author_sort Laycock, Paul
collection CERN
description In this presentation, the data preparation workflows for Run 2 are presented. Online data quality uses a new hybrid software release that incorporates the latest offline data quality monitoring software for the online environment. This is used to provide fast feedback in the control room during a data acquisition (DAQ) run, via a histogram-based monitoring framework as well as the online Event Display. Data are sent to several streams for offline processing at the dedicated Tier-0 computing facility, including dedicated calibration streams and an "express" physics stream containing approximately 2% of the main physics stream. This express stream is processed as data arrives, allowing a first look at the offline data quality within hours of a run end. A prompt calibration loop starts once an ATLAS DAQ run ends, nominally defining a 48 hour period in which calibrations and alignments can be derived using the dedicated calibration and express streams. The bulk processing of the main physics stream starts on expiry of the prompt calibration loop, normally providing the primary physics format after a further 24 hours. Physics data quality is assessed using the same monitoring packages, allowing data exclusion down to a granularity of one luminosity block or 1 minute. Meanwhile, the primary reconstruction output is passed to the ATLAS data reduction framework, providing data to users typically within 5 days of the end of a DAQ run, and on the same time scale as the data quality good run list.
id cern-2221220
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2016
record_format invenio
spelling cern-22212202019-09-30T06:29:59Zhttp://cds.cern.ch/record/2221220engLaycock, PaulATLAS Data Preparation in Run 2Particle Physics - ExperimentIn this presentation, the data preparation workflows for Run 2 are presented. Online data quality uses a new hybrid software release that incorporates the latest offline data quality monitoring software for the online environment. This is used to provide fast feedback in the control room during a data acquisition (DAQ) run, via a histogram-based monitoring framework as well as the online Event Display. Data are sent to several streams for offline processing at the dedicated Tier-0 computing facility, including dedicated calibration streams and an "express" physics stream containing approximately 2% of the main physics stream. This express stream is processed as data arrives, allowing a first look at the offline data quality within hours of a run end. A prompt calibration loop starts once an ATLAS DAQ run ends, nominally defining a 48 hour period in which calibrations and alignments can be derived using the dedicated calibration and express streams. The bulk processing of the main physics stream starts on expiry of the prompt calibration loop, normally providing the primary physics format after a further 24 hours. Physics data quality is assessed using the same monitoring packages, allowing data exclusion down to a granularity of one luminosity block or 1 minute. Meanwhile, the primary reconstruction output is passed to the ATLAS data reduction framework, providing data to users typically within 5 days of the end of a DAQ run, and on the same time scale as the data quality good run list.ATL-SOFT-SLIDE-2016-755oai:cds.cern.ch:22212202016-10-04
spellingShingle Particle Physics - Experiment
Laycock, Paul
ATLAS Data Preparation in Run 2
title ATLAS Data Preparation in Run 2
title_full ATLAS Data Preparation in Run 2
title_fullStr ATLAS Data Preparation in Run 2
title_full_unstemmed ATLAS Data Preparation in Run 2
title_short ATLAS Data Preparation in Run 2
title_sort atlas data preparation in run 2
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2221220
work_keys_str_mv AT laycockpaul atlasdatapreparationinrun2