Cargando…

The ATLAS EventIndex for LHC Run 3

The ATLAS Event Index was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones,...

Descripción completa

Detalles Bibliográficos
Autores principales: Barberis, Dario, Alexandrov, Evgeny, Aleksandrov, Igor, Baranowski, Zbigniew, Dimitrov, Gancho, Fernandez Casani, Alvaro, Gallas, Elizabeth, Garcia Montoro, Carlos, Gonzalez de la Hoz, Santiago, Hrivnac, Julius, Kazymov, Andrei, Mineev, Mikhail, Prokoshin, Fedor, Rybkin, Grigori, Sánchez, Javier, Salt, José, Villaplana Perez, Miguel
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:http://cds.cern.ch/record/2695209
_version_ 1780964128568901632
author Barberis, Dario
Alexandrov, Evgeny
Aleksandrov, Igor
Baranowski, Zbigniew
Dimitrov, Gancho
Fernandez Casani, Alvaro
Gallas, Elizabeth
Garcia Montoro, Carlos
Gonzalez de la Hoz, Santiago
Hrivnac, Julius
Kazymov, Andrei
Mineev, Mikhail
Prokoshin, Fedor
Rybkin, Grigori
Sánchez, Javier
Salt, José
Villaplana Perez, Miguel
author_facet Barberis, Dario
Alexandrov, Evgeny
Aleksandrov, Igor
Baranowski, Zbigniew
Dimitrov, Gancho
Fernandez Casani, Alvaro
Gallas, Elizabeth
Garcia Montoro, Carlos
Gonzalez de la Hoz, Santiago
Hrivnac, Julius
Kazymov, Andrei
Mineev, Mikhail
Prokoshin, Fedor
Rybkin, Grigori
Sánchez, Javier
Salt, José
Villaplana Perez, Miguel
author_sort Barberis, Dario
collection CERN
description The ATLAS Event Index was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones, such as production consistency checks, duplicate event detection and measurements of the overlaps of trigger chains and derivation datasets. LHC Run 3, starting in 2021, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will be able to provide at least the same functionality as the current one for increased data ingestion and search rates and with increasing volumes of stored data. It is based on a set of HBase tables, with schemas derived from the current Oracle implementation, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, allowing us to re-use most of the existing code for metadata integration.
id cern-2695209
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26952092019-10-22T19:59:13Zhttp://cds.cern.ch/record/2695209engBarberis, DarioAlexandrov, EvgenyAleksandrov, IgorBaranowski, ZbigniewDimitrov, GanchoFernandez Casani, AlvaroGallas, ElizabethGarcia Montoro, CarlosGonzalez de la Hoz, SantiagoHrivnac, JuliusKazymov, AndreiMineev, MikhailProkoshin, FedorRybkin, GrigoriSánchez, JavierSalt, JoséVillaplana Perez, MiguelThe ATLAS EventIndex for LHC Run 3Particle Physics - ExperimentThe ATLAS Event Index was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones, such as production consistency checks, duplicate event detection and measurements of the overlaps of trigger chains and derivation datasets. LHC Run 3, starting in 2021, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will be able to provide at least the same functionality as the current one for increased data ingestion and search rates and with increasing volumes of stored data. It is based on a set of HBase tables, with schemas derived from the current Oracle implementation, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, allowing us to re-use most of the existing code for metadata integration.ATL-SOFT-SLIDE-2019-794oai:cds.cern.ch:26952092019-10-22
spellingShingle Particle Physics - Experiment
Barberis, Dario
Alexandrov, Evgeny
Aleksandrov, Igor
Baranowski, Zbigniew
Dimitrov, Gancho
Fernandez Casani, Alvaro
Gallas, Elizabeth
Garcia Montoro, Carlos
Gonzalez de la Hoz, Santiago
Hrivnac, Julius
Kazymov, Andrei
Mineev, Mikhail
Prokoshin, Fedor
Rybkin, Grigori
Sánchez, Javier
Salt, José
Villaplana Perez, Miguel
The ATLAS EventIndex for LHC Run 3
title The ATLAS EventIndex for LHC Run 3
title_full The ATLAS EventIndex for LHC Run 3
title_fullStr The ATLAS EventIndex for LHC Run 3
title_full_unstemmed The ATLAS EventIndex for LHC Run 3
title_short The ATLAS EventIndex for LHC Run 3
title_sort atlas eventindex for lhc run 3
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2695209
work_keys_str_mv AT barberisdario theatlaseventindexforlhcrun3
AT alexandrovevgeny theatlaseventindexforlhcrun3
AT aleksandrovigor theatlaseventindexforlhcrun3
AT baranowskizbigniew theatlaseventindexforlhcrun3
AT dimitrovgancho theatlaseventindexforlhcrun3
AT fernandezcasanialvaro theatlaseventindexforlhcrun3
AT gallaselizabeth theatlaseventindexforlhcrun3
AT garciamontorocarlos theatlaseventindexforlhcrun3
AT gonzalezdelahozsantiago theatlaseventindexforlhcrun3
AT hrivnacjulius theatlaseventindexforlhcrun3
AT kazymovandrei theatlaseventindexforlhcrun3
AT mineevmikhail theatlaseventindexforlhcrun3
AT prokoshinfedor theatlaseventindexforlhcrun3
AT rybkingrigori theatlaseventindexforlhcrun3
AT sanchezjavier theatlaseventindexforlhcrun3
AT saltjose theatlaseventindexforlhcrun3
AT villaplanaperezmiguel theatlaseventindexforlhcrun3
AT barberisdario atlaseventindexforlhcrun3
AT alexandrovevgeny atlaseventindexforlhcrun3
AT aleksandrovigor atlaseventindexforlhcrun3
AT baranowskizbigniew atlaseventindexforlhcrun3
AT dimitrovgancho atlaseventindexforlhcrun3
AT fernandezcasanialvaro atlaseventindexforlhcrun3
AT gallaselizabeth atlaseventindexforlhcrun3
AT garciamontorocarlos atlaseventindexforlhcrun3
AT gonzalezdelahozsantiago atlaseventindexforlhcrun3
AT hrivnacjulius atlaseventindexforlhcrun3
AT kazymovandrei atlaseventindexforlhcrun3
AT mineevmikhail atlaseventindexforlhcrun3
AT prokoshinfedor atlaseventindexforlhcrun3
AT rybkingrigori atlaseventindexforlhcrun3
AT sanchezjavier atlaseventindexforlhcrun3
AT saltjose atlaseventindexforlhcrun3
AT villaplanaperezmiguel atlaseventindexforlhcrun3