Cargando…

An extensible infrastructure for querying and mining event-level metadata in ATLAS

The ATLAS event-level metadata infrastructure supports applications that range from data quality monitoring, anomaly detection, and fast physics monitoring to event-level selection and navigation to file-resident event data at any processing stage, from raw through analysis object data, in globally...

Descripción completa

Detalles Bibliográficos
Autores principales: Malon, D, Cranshaw, J, Zhang, Q
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1449135
_version_ 1780924881593958400
author Malon, D
Cranshaw, J
Zhang, Q
author_facet Malon, D
Cranshaw, J
Zhang, Q
author_sort Malon, D
collection CERN
description The ATLAS event-level metadata infrastructure supports applications that range from data quality monitoring, anomaly detection, and fast physics monitoring to event-level selection and navigation to file-resident event data at any processing stage, from raw through analysis object data, in globally distributed analysis. A central component of the infrastructure is a distributed TAG database, which contains event-level metadata records for all ATLAS events, real and simulated. This resource offers a unique global view of ATLAS data, and provides an opportunity, not only for stream-style mining of event data, but also for an examination of data across streams, across runs, and across (re)processings. The TAG database serves as a natural locus for run-level and processing-level integrity checks, for investigations of event duplication and other issues in the trigger and offline systems, for questions about stream overlap, for queries about interesting but out-of-stream events, for statistics, and more. In early ATLAS running, such database queries were largely ad hoc, and were handled manually. In this paper, we describe an extensible infrastructure for addressing these and other use cases during upload and post-upload processing, and discuss some of the uses to which this infrastructure has been applied.
id cern-1449135
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14491352019-09-30T06:29:59Zhttp://cds.cern.ch/record/1449135engMalon, DCranshaw, JZhang, QAn extensible infrastructure for querying and mining event-level metadata in ATLASDetectors and Experimental TechniquesThe ATLAS event-level metadata infrastructure supports applications that range from data quality monitoring, anomaly detection, and fast physics monitoring to event-level selection and navigation to file-resident event data at any processing stage, from raw through analysis object data, in globally distributed analysis. A central component of the infrastructure is a distributed TAG database, which contains event-level metadata records for all ATLAS events, real and simulated. This resource offers a unique global view of ATLAS data, and provides an opportunity, not only for stream-style mining of event data, but also for an examination of data across streams, across runs, and across (re)processings. The TAG database serves as a natural locus for run-level and processing-level integrity checks, for investigations of event duplication and other issues in the trigger and offline systems, for questions about stream overlap, for queries about interesting but out-of-stream events, for statistics, and more. In early ATLAS running, such database queries were largely ad hoc, and were handled manually. In this paper, we describe an extensible infrastructure for addressing these and other use cases during upload and post-upload processing, and discuss some of the uses to which this infrastructure has been applied.ATL-SOFT-SLIDE-2012-233oai:cds.cern.ch:14491352012-05-16
spellingShingle Detectors and Experimental Techniques
Malon, D
Cranshaw, J
Zhang, Q
An extensible infrastructure for querying and mining event-level metadata in ATLAS
title An extensible infrastructure for querying and mining event-level metadata in ATLAS
title_full An extensible infrastructure for querying and mining event-level metadata in ATLAS
title_fullStr An extensible infrastructure for querying and mining event-level metadata in ATLAS
title_full_unstemmed An extensible infrastructure for querying and mining event-level metadata in ATLAS
title_short An extensible infrastructure for querying and mining event-level metadata in ATLAS
title_sort extensible infrastructure for querying and mining event-level metadata in atlas
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1449135
work_keys_str_mv AT malond anextensibleinfrastructureforqueryingandminingeventlevelmetadatainatlas
AT cranshawj anextensibleinfrastructureforqueryingandminingeventlevelmetadatainatlas
AT zhangq anextensibleinfrastructureforqueryingandminingeventlevelmetadatainatlas
AT malond extensibleinfrastructureforqueryingandminingeventlevelmetadatainatlas
AT cranshawj extensibleinfrastructureforqueryingandminingeventlevelmetadatainatlas
AT zhangq extensibleinfrastructureforqueryingandminingeventlevelmetadatainatlas