Cargando…

The ATLAS EventIndex: architecture, design choices, deployment and first operation experience

The EventIndex is the complete catalogue of all ATLAS events, keeping the references to all files that contain a given event in any processing stage. It replaces the TAG database, which had been in use during LHC Run 1. For each event it contains its identifiers, the trigger pattern and the GUIDs of...

Descripción completa

Detalles Bibliográficos
Autores principales: Barberis, Dario, Cardenas Zarate, Simon Ernesto, Cranshaw, Jack, Favareto, Andrea, Fernandez Casani, Alvaro, Gallas, Elizabeth, Glasman, Claudia, Gonzalez de la Hoz, Santiago, Hrivnac, Julius, Malon, David, Prokoshin, Fedor, Salt, José, Sánchez, Javier, Toebbicke, Rainer, Yuan, Ruijun
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/664/4/042003
http://cds.cern.ch/record/2014725
_version_ 1780946640030400512
author Barberis, Dario
Cardenas Zarate, Simon Ernesto
Cranshaw, Jack
Favareto, Andrea
Fernandez Casani, Alvaro
Gallas, Elizabeth
Glasman, Claudia
Gonzalez de la Hoz, Santiago
Hrivnac, Julius
Malon, David
Prokoshin, Fedor
Salt, José
Sánchez, Javier
Toebbicke, Rainer
Yuan, Ruijun
author_facet Barberis, Dario
Cardenas Zarate, Simon Ernesto
Cranshaw, Jack
Favareto, Andrea
Fernandez Casani, Alvaro
Gallas, Elizabeth
Glasman, Claudia
Gonzalez de la Hoz, Santiago
Hrivnac, Julius
Malon, David
Prokoshin, Fedor
Salt, José
Sánchez, Javier
Toebbicke, Rainer
Yuan, Ruijun
author_sort Barberis, Dario
collection CERN
description The EventIndex is the complete catalogue of all ATLAS events, keeping the references to all files that contain a given event in any processing stage. It replaces the TAG database, which had been in use during LHC Run 1. For each event it contains its identifiers, the trigger pattern and the GUIDs of the files containing it. Major use cases are event picking, feeding the Event Service used on some production sites, and technical checks of the completion and consistency of processing campaigns. The system design is highly modular so that its components (data collection system, storage system based on Hadoop, query web service and interfaces to other ATLAS systems) could be developed separately and in parallel during LS1. The EventIndex is in operation for the start of LHC Run 2. This paper describes the high-level system architecture, the technical design choices and the deployment process and issues. The performance of the data collection and storage systems, as well as the query services, are also reported.
id cern-2014725
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling cern-20147252022-08-10T13:07:42Zdoi:10.1088/1742-6596/664/4/042003http://cds.cern.ch/record/2014725engBarberis, DarioCardenas Zarate, Simon ErnestoCranshaw, JackFavareto, AndreaFernandez Casani, AlvaroGallas, ElizabethGlasman, ClaudiaGonzalez de la Hoz, SantiagoHrivnac, JuliusMalon, DavidProkoshin, FedorSalt, JoséSánchez, JavierToebbicke, RainerYuan, RuijunThe ATLAS EventIndex: architecture, design choices, deployment and first operation experienceParticle Physics - ExperimentThe EventIndex is the complete catalogue of all ATLAS events, keeping the references to all files that contain a given event in any processing stage. It replaces the TAG database, which had been in use during LHC Run 1. For each event it contains its identifiers, the trigger pattern and the GUIDs of the files containing it. Major use cases are event picking, feeding the Event Service used on some production sites, and technical checks of the completion and consistency of processing campaigns. The system design is highly modular so that its components (data collection system, storage system based on Hadoop, query web service and interfaces to other ATLAS systems) could be developed separately and in parallel during LS1. The EventIndex is in operation for the start of LHC Run 2. This paper describes the high-level system architecture, the technical design choices and the deployment process and issues. The performance of the data collection and storage systems, as well as the query services, are also reported.ATL-SOFT-PROC-2015-008oai:cds.cern.ch:20147252015-05-08
spellingShingle Particle Physics - Experiment
Barberis, Dario
Cardenas Zarate, Simon Ernesto
Cranshaw, Jack
Favareto, Andrea
Fernandez Casani, Alvaro
Gallas, Elizabeth
Glasman, Claudia
Gonzalez de la Hoz, Santiago
Hrivnac, Julius
Malon, David
Prokoshin, Fedor
Salt, José
Sánchez, Javier
Toebbicke, Rainer
Yuan, Ruijun
The ATLAS EventIndex: architecture, design choices, deployment and first operation experience
title The ATLAS EventIndex: architecture, design choices, deployment and first operation experience
title_full The ATLAS EventIndex: architecture, design choices, deployment and first operation experience
title_fullStr The ATLAS EventIndex: architecture, design choices, deployment and first operation experience
title_full_unstemmed The ATLAS EventIndex: architecture, design choices, deployment and first operation experience
title_short The ATLAS EventIndex: architecture, design choices, deployment and first operation experience
title_sort atlas eventindex: architecture, design choices, deployment and first operation experience
topic Particle Physics - Experiment
url https://dx.doi.org/10.1088/1742-6596/664/4/042003
http://cds.cern.ch/record/2014725
work_keys_str_mv AT barberisdario theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT cardenaszaratesimonernesto theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT cranshawjack theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT favaretoandrea theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT fernandezcasanialvaro theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT gallaselizabeth theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT glasmanclaudia theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT gonzalezdelahozsantiago theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT hrivnacjulius theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT malondavid theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT prokoshinfedor theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT saltjose theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT sanchezjavier theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT toebbickerainer theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT yuanruijun theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT barberisdario atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT cardenaszaratesimonernesto atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT cranshawjack atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT favaretoandrea atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT fernandezcasanialvaro atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT gallaselizabeth atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT glasmanclaudia atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT gonzalezdelahozsantiago atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT hrivnacjulius atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT malondavid atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT prokoshinfedor atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT saltjose atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT sanchezjavier atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT toebbickerainer atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience
AT yuanruijun atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience