Cargando…
The ATLAS EventIndex for LHC Run 3
The ATLAS Event Index was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones,...
Autores principales: | , , , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2019
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2695209 |
_version_ | 1780964128568901632 |
---|---|
author | Barberis, Dario Alexandrov, Evgeny Aleksandrov, Igor Baranowski, Zbigniew Dimitrov, Gancho Fernandez Casani, Alvaro Gallas, Elizabeth Garcia Montoro, Carlos Gonzalez de la Hoz, Santiago Hrivnac, Julius Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Sánchez, Javier Salt, José Villaplana Perez, Miguel |
author_facet | Barberis, Dario Alexandrov, Evgeny Aleksandrov, Igor Baranowski, Zbigniew Dimitrov, Gancho Fernandez Casani, Alvaro Gallas, Elizabeth Garcia Montoro, Carlos Gonzalez de la Hoz, Santiago Hrivnac, Julius Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Sánchez, Javier Salt, José Villaplana Perez, Miguel |
author_sort | Barberis, Dario |
collection | CERN |
description | The ATLAS Event Index was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones, such as production consistency checks, duplicate event detection and measurements of the overlaps of trigger chains and derivation datasets. LHC Run 3, starting in 2021, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will be able to provide at least the same functionality as the current one for increased data ingestion and search rates and with increasing volumes of stored data. It is based on a set of HBase tables, with schemas derived from the current Oracle implementation, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, allowing us to re-use most of the existing code for metadata integration. |
id | cern-2695209 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2019 |
record_format | invenio |
spelling | cern-26952092019-10-22T19:59:13Zhttp://cds.cern.ch/record/2695209engBarberis, DarioAlexandrov, EvgenyAleksandrov, IgorBaranowski, ZbigniewDimitrov, GanchoFernandez Casani, AlvaroGallas, ElizabethGarcia Montoro, CarlosGonzalez de la Hoz, SantiagoHrivnac, JuliusKazymov, AndreiMineev, MikhailProkoshin, FedorRybkin, GrigoriSánchez, JavierSalt, JoséVillaplana Perez, MiguelThe ATLAS EventIndex for LHC Run 3Particle Physics - ExperimentThe ATLAS Event Index was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones, such as production consistency checks, duplicate event detection and measurements of the overlaps of trigger chains and derivation datasets. LHC Run 3, starting in 2021, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will be able to provide at least the same functionality as the current one for increased data ingestion and search rates and with increasing volumes of stored data. It is based on a set of HBase tables, with schemas derived from the current Oracle implementation, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, allowing us to re-use most of the existing code for metadata integration.ATL-SOFT-SLIDE-2019-794oai:cds.cern.ch:26952092019-10-22 |
spellingShingle | Particle Physics - Experiment Barberis, Dario Alexandrov, Evgeny Aleksandrov, Igor Baranowski, Zbigniew Dimitrov, Gancho Fernandez Casani, Alvaro Gallas, Elizabeth Garcia Montoro, Carlos Gonzalez de la Hoz, Santiago Hrivnac, Julius Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Sánchez, Javier Salt, José Villaplana Perez, Miguel The ATLAS EventIndex for LHC Run 3 |
title | The ATLAS EventIndex for LHC Run 3 |
title_full | The ATLAS EventIndex for LHC Run 3 |
title_fullStr | The ATLAS EventIndex for LHC Run 3 |
title_full_unstemmed | The ATLAS EventIndex for LHC Run 3 |
title_short | The ATLAS EventIndex for LHC Run 3 |
title_sort | atlas eventindex for lhc run 3 |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2695209 |
work_keys_str_mv | AT barberisdario theatlaseventindexforlhcrun3 AT alexandrovevgeny theatlaseventindexforlhcrun3 AT aleksandrovigor theatlaseventindexforlhcrun3 AT baranowskizbigniew theatlaseventindexforlhcrun3 AT dimitrovgancho theatlaseventindexforlhcrun3 AT fernandezcasanialvaro theatlaseventindexforlhcrun3 AT gallaselizabeth theatlaseventindexforlhcrun3 AT garciamontorocarlos theatlaseventindexforlhcrun3 AT gonzalezdelahozsantiago theatlaseventindexforlhcrun3 AT hrivnacjulius theatlaseventindexforlhcrun3 AT kazymovandrei theatlaseventindexforlhcrun3 AT mineevmikhail theatlaseventindexforlhcrun3 AT prokoshinfedor theatlaseventindexforlhcrun3 AT rybkingrigori theatlaseventindexforlhcrun3 AT sanchezjavier theatlaseventindexforlhcrun3 AT saltjose theatlaseventindexforlhcrun3 AT villaplanaperezmiguel theatlaseventindexforlhcrun3 AT barberisdario atlaseventindexforlhcrun3 AT alexandrovevgeny atlaseventindexforlhcrun3 AT aleksandrovigor atlaseventindexforlhcrun3 AT baranowskizbigniew atlaseventindexforlhcrun3 AT dimitrovgancho atlaseventindexforlhcrun3 AT fernandezcasanialvaro atlaseventindexforlhcrun3 AT gallaselizabeth atlaseventindexforlhcrun3 AT garciamontorocarlos atlaseventindexforlhcrun3 AT gonzalezdelahozsantiago atlaseventindexforlhcrun3 AT hrivnacjulius atlaseventindexforlhcrun3 AT kazymovandrei atlaseventindexforlhcrun3 AT mineevmikhail atlaseventindexforlhcrun3 AT prokoshinfedor atlaseventindexforlhcrun3 AT rybkingrigori atlaseventindexforlhcrun3 AT sanchezjavier atlaseventindexforlhcrun3 AT saltjose atlaseventindexforlhcrun3 AT villaplanaperezmiguel atlaseventindexforlhcrun3 |