Cargando…
The ATLAS EventIndex using the HBase/Phoenix storage solution
The ATLAS EventIndex provides a global event catalogue and event-level metadata for ATLAS analysis groups and users. The LHC Run 3, starting in 2022, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its lim...
| Autores principales: | , , , , , , , , , , , , , , , , , |
|---|---|
| Lenguaje: | eng |
| Publicado: |
2021
|
| Materias: | |
| Acceso en línea: | http://cds.cern.ch/record/2774410 |
| _version_ | 1780971548743565312 |
|---|---|
| author | Alexandrov, Evgeny Alexandrov, Igor Barberis, Dario Canali, Luca Fernandez Casani, Alvaro Cherepanova, Elizaveta Gallas, Elizabeth Garcia Montoro, Carlos Gonzalez De La Hoz, Santiago Hrivnac, Julius Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Sanchez Martinez, Francisco Javier Salt, Jose Villaplana, Miguel Yakovlev, Alexandre |
| author_facet | Alexandrov, Evgeny Alexandrov, Igor Barberis, Dario Canali, Luca Fernandez Casani, Alvaro Cherepanova, Elizaveta Gallas, Elizabeth Garcia Montoro, Carlos Gonzalez De La Hoz, Santiago Hrivnac, Julius Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Sanchez Martinez, Francisco Javier Salt, Jose Villaplana, Miguel Yakovlev, Alexandre |
| author_sort | Alexandrov, Evgeny |
| collection | CERN |
| description | The ATLAS EventIndex provides a global event catalogue and event-level metadata for ATLAS analysis groups and users. The LHC Run 3, starting in 2022, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will provide at least the same functionality as the current one for increased data ingestion and search rates, and with increasing volumes of stored data. It is based on a set of HBase tables, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, which allows the re-use of most of the existing code for metadata integration. |
| id | cern-2774410 |
| institution | Organización Europea para la Investigación Nuclear |
| language | eng |
| publishDate | 2021 |
| record_format | invenio |
| spelling | cern-27744102022-08-03T09:41:13Zhttp://cds.cern.ch/record/2774410engAlexandrov, EvgenyAlexandrov, IgorBarberis, DarioCanali, LucaFernandez Casani, AlvaroCherepanova, ElizavetaGallas, ElizabethGarcia Montoro, CarlosGonzalez De La Hoz, SantiagoHrivnac, JuliusKazymov, AndreiMineev, MikhailProkoshin, FedorRybkin, GrigoriSanchez Martinez, Francisco JavierSalt, JoseVillaplana, MiguelYakovlev, AlexandreThe ATLAS EventIndex using the HBase/Phoenix storage solutionParticle Physics - ExperimentThe ATLAS EventIndex provides a global event catalogue and event-level metadata for ATLAS analysis groups and users. The LHC Run 3, starting in 2022, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will provide at least the same functionality as the current one for increased data ingestion and search rates, and with increasing volumes of stored data. It is based on a set of HBase tables, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, which allows the re-use of most of the existing code for metadata integration.ATL-SOFT-SLIDE-2021-306oai:cds.cern.ch:27744102021-06-30 |
| spellingShingle | Particle Physics - Experiment Alexandrov, Evgeny Alexandrov, Igor Barberis, Dario Canali, Luca Fernandez Casani, Alvaro Cherepanova, Elizaveta Gallas, Elizabeth Garcia Montoro, Carlos Gonzalez De La Hoz, Santiago Hrivnac, Julius Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Sanchez Martinez, Francisco Javier Salt, Jose Villaplana, Miguel Yakovlev, Alexandre The ATLAS EventIndex using the HBase/Phoenix storage solution |
| title | The ATLAS EventIndex using the HBase/Phoenix storage solution |
| title_full | The ATLAS EventIndex using the HBase/Phoenix storage solution |
| title_fullStr | The ATLAS EventIndex using the HBase/Phoenix storage solution |
| title_full_unstemmed | The ATLAS EventIndex using the HBase/Phoenix storage solution |
| title_short | The ATLAS EventIndex using the HBase/Phoenix storage solution |
| title_sort | atlas eventindex using the hbase/phoenix storage solution |
| topic | Particle Physics - Experiment |
| url | http://cds.cern.ch/record/2774410 |
| work_keys_str_mv | AT alexandrovevgeny theatlaseventindexusingthehbasephoenixstoragesolution AT alexandrovigor theatlaseventindexusingthehbasephoenixstoragesolution AT barberisdario theatlaseventindexusingthehbasephoenixstoragesolution AT canaliluca theatlaseventindexusingthehbasephoenixstoragesolution AT fernandezcasanialvaro theatlaseventindexusingthehbasephoenixstoragesolution AT cherepanovaelizaveta theatlaseventindexusingthehbasephoenixstoragesolution AT gallaselizabeth theatlaseventindexusingthehbasephoenixstoragesolution AT garciamontorocarlos theatlaseventindexusingthehbasephoenixstoragesolution AT gonzalezdelahozsantiago theatlaseventindexusingthehbasephoenixstoragesolution AT hrivnacjulius theatlaseventindexusingthehbasephoenixstoragesolution AT kazymovandrei theatlaseventindexusingthehbasephoenixstoragesolution AT mineevmikhail theatlaseventindexusingthehbasephoenixstoragesolution AT prokoshinfedor theatlaseventindexusingthehbasephoenixstoragesolution AT rybkingrigori theatlaseventindexusingthehbasephoenixstoragesolution AT sanchezmartinezfranciscojavier theatlaseventindexusingthehbasephoenixstoragesolution AT saltjose theatlaseventindexusingthehbasephoenixstoragesolution AT villaplanamiguel theatlaseventindexusingthehbasephoenixstoragesolution AT yakovlevalexandre theatlaseventindexusingthehbasephoenixstoragesolution AT alexandrovevgeny atlaseventindexusingthehbasephoenixstoragesolution AT alexandrovigor atlaseventindexusingthehbasephoenixstoragesolution AT barberisdario atlaseventindexusingthehbasephoenixstoragesolution AT canaliluca atlaseventindexusingthehbasephoenixstoragesolution AT fernandezcasanialvaro atlaseventindexusingthehbasephoenixstoragesolution AT cherepanovaelizaveta atlaseventindexusingthehbasephoenixstoragesolution AT gallaselizabeth atlaseventindexusingthehbasephoenixstoragesolution AT garciamontorocarlos atlaseventindexusingthehbasephoenixstoragesolution AT gonzalezdelahozsantiago atlaseventindexusingthehbasephoenixstoragesolution AT hrivnacjulius atlaseventindexusingthehbasephoenixstoragesolution AT kazymovandrei atlaseventindexusingthehbasephoenixstoragesolution AT mineevmikhail atlaseventindexusingthehbasephoenixstoragesolution AT prokoshinfedor atlaseventindexusingthehbasephoenixstoragesolution AT rybkingrigori atlaseventindexusingthehbasephoenixstoragesolution AT sanchezmartinezfranciscojavier atlaseventindexusingthehbasephoenixstoragesolution AT saltjose atlaseventindexusingthehbasephoenixstoragesolution AT villaplanamiguel atlaseventindexusingthehbasephoenixstoragesolution AT yakovlevalexandre atlaseventindexusingthehbasephoenixstoragesolution |