Cargando…
The ATLAS EventIndex: architecture, design choices, deployment and first operation experience
The EventIndex is the complete catalogue of all ATLAS events, keeping the references to all files that contain a given event in any processing stage. It replaces the TAG database, which had been in use during LHC Run 1. For each event it contains its identifiers, the trigger pattern and the GUIDs of...
Autores principales: | , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/664/4/042003 http://cds.cern.ch/record/2014725 |
_version_ | 1780946640030400512 |
---|---|
author | Barberis, Dario Cardenas Zarate, Simon Ernesto Cranshaw, Jack Favareto, Andrea Fernandez Casani, Alvaro Gallas, Elizabeth Glasman, Claudia Gonzalez de la Hoz, Santiago Hrivnac, Julius Malon, David Prokoshin, Fedor Salt, José Sánchez, Javier Toebbicke, Rainer Yuan, Ruijun |
author_facet | Barberis, Dario Cardenas Zarate, Simon Ernesto Cranshaw, Jack Favareto, Andrea Fernandez Casani, Alvaro Gallas, Elizabeth Glasman, Claudia Gonzalez de la Hoz, Santiago Hrivnac, Julius Malon, David Prokoshin, Fedor Salt, José Sánchez, Javier Toebbicke, Rainer Yuan, Ruijun |
author_sort | Barberis, Dario |
collection | CERN |
description | The EventIndex is the complete catalogue of all ATLAS events, keeping the references to all files that contain a given event in any processing stage. It replaces the TAG database, which had been in use during LHC Run 1. For each event it contains its identifiers, the trigger pattern and the GUIDs of the files containing it. Major use cases are event picking, feeding the Event Service used on some production sites, and technical checks of the completion and consistency of processing campaigns. The system design is highly modular so that its components (data collection system, storage system based on Hadoop, query web service and interfaces to other ATLAS systems) could be developed separately and in parallel during LS1. The EventIndex is in operation for the start of LHC Run 2. This paper describes the high-level system architecture, the technical design choices and the deployment process and issues. The performance of the data collection and storage systems, as well as the query services, are also reported. |
id | cern-2014725 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | cern-20147252022-08-10T13:07:42Zdoi:10.1088/1742-6596/664/4/042003http://cds.cern.ch/record/2014725engBarberis, DarioCardenas Zarate, Simon ErnestoCranshaw, JackFavareto, AndreaFernandez Casani, AlvaroGallas, ElizabethGlasman, ClaudiaGonzalez de la Hoz, SantiagoHrivnac, JuliusMalon, DavidProkoshin, FedorSalt, JoséSánchez, JavierToebbicke, RainerYuan, RuijunThe ATLAS EventIndex: architecture, design choices, deployment and first operation experienceParticle Physics - ExperimentThe EventIndex is the complete catalogue of all ATLAS events, keeping the references to all files that contain a given event in any processing stage. It replaces the TAG database, which had been in use during LHC Run 1. For each event it contains its identifiers, the trigger pattern and the GUIDs of the files containing it. Major use cases are event picking, feeding the Event Service used on some production sites, and technical checks of the completion and consistency of processing campaigns. The system design is highly modular so that its components (data collection system, storage system based on Hadoop, query web service and interfaces to other ATLAS systems) could be developed separately and in parallel during LS1. The EventIndex is in operation for the start of LHC Run 2. This paper describes the high-level system architecture, the technical design choices and the deployment process and issues. The performance of the data collection and storage systems, as well as the query services, are also reported.ATL-SOFT-PROC-2015-008oai:cds.cern.ch:20147252015-05-08 |
spellingShingle | Particle Physics - Experiment Barberis, Dario Cardenas Zarate, Simon Ernesto Cranshaw, Jack Favareto, Andrea Fernandez Casani, Alvaro Gallas, Elizabeth Glasman, Claudia Gonzalez de la Hoz, Santiago Hrivnac, Julius Malon, David Prokoshin, Fedor Salt, José Sánchez, Javier Toebbicke, Rainer Yuan, Ruijun The ATLAS EventIndex: architecture, design choices, deployment and first operation experience |
title | The ATLAS EventIndex: architecture, design choices, deployment and first operation experience |
title_full | The ATLAS EventIndex: architecture, design choices, deployment and first operation experience |
title_fullStr | The ATLAS EventIndex: architecture, design choices, deployment and first operation experience |
title_full_unstemmed | The ATLAS EventIndex: architecture, design choices, deployment and first operation experience |
title_short | The ATLAS EventIndex: architecture, design choices, deployment and first operation experience |
title_sort | atlas eventindex: architecture, design choices, deployment and first operation experience |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1088/1742-6596/664/4/042003 http://cds.cern.ch/record/2014725 |
work_keys_str_mv | AT barberisdario theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT cardenaszaratesimonernesto theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT cranshawjack theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT favaretoandrea theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT fernandezcasanialvaro theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT gallaselizabeth theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT glasmanclaudia theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT gonzalezdelahozsantiago theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT hrivnacjulius theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT malondavid theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT prokoshinfedor theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT saltjose theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT sanchezjavier theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT toebbickerainer theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT yuanruijun theatlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT barberisdario atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT cardenaszaratesimonernesto atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT cranshawjack atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT favaretoandrea atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT fernandezcasanialvaro atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT gallaselizabeth atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT glasmanclaudia atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT gonzalezdelahozsantiago atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT hrivnacjulius atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT malondavid atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT prokoshinfedor atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT saltjose atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT sanchezjavier atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT toebbickerainer atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience AT yuanruijun atlaseventindexarchitecturedesignchoicesdeploymentandfirstoperationexperience |