Cargando…
Deployment and Operation of the ATLAS EventIndex for LHC Run 3
The ATLAS EventIndex is the global catalogue of all ATLAS real and simulated events. During the LHC long shutdown between Run 2 (2015-2018) and Run 3 (2022-2025) all its components were substantially revised and a new system was deployed for the start of Run 3 in Spring 2022. The new core storage sy...
Autores principales: | , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2023
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2870346 |
_version_ | 1780978329318326272 |
---|---|
author | Gallas, Elizabeth Alexandrov, Evgeny Alexandrov, Igor Barberis, Dario Canali, Luca Cherepanova, Elizaveta Fernandez Casani, Alvaro Garcia Montoro, Carlos Gonzalez De La Hoz, Santiago Iakovlev, Alexander Prokoshin, Fedor Salt, Jose Sanchez Martinez, Francisco Javier Rybkin, Grigori Villaplana, Miguel |
author_facet | Gallas, Elizabeth Alexandrov, Evgeny Alexandrov, Igor Barberis, Dario Canali, Luca Cherepanova, Elizaveta Fernandez Casani, Alvaro Garcia Montoro, Carlos Gonzalez De La Hoz, Santiago Iakovlev, Alexander Prokoshin, Fedor Salt, Jose Sanchez Martinez, Francisco Javier Rybkin, Grigori Villaplana, Miguel |
author_sort | Gallas, Elizabeth |
collection | CERN |
description | The ATLAS EventIndex is the global catalogue of all ATLAS real and simulated events. During the LHC long shutdown between Run 2 (2015-2018) and Run 3 (2022-2025) all its components were substantially revised and a new system was deployed for the start of Run 3 in Spring 2022. The new core storage system, based on HBase tables with a Phoenix interface rather than HDFS MapFiles, allows much faster data ingestion rates and scales much better than the old one to the data rates expected for the end of Run 3 and beyond. All user interfaces were also revised and a new command-line interface and web services were also deployed. The new system was initially populated with all existing data relative to Run 1 and Run 2 datasets, and then put online to receive Run 3 data in real time. After extensive testing, the old system, which ran in parallel to the new one for a few months, was finally switched off in October 2022. This paper describes the new system, the move of all existing data from the old to the new storage schemas and the operational experience gathered so far. |
id | cern-2870346 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2023 |
record_format | invenio |
spelling | cern-28703462023-09-14T20:22:09Zhttp://cds.cern.ch/record/2870346engGallas, ElizabethAlexandrov, EvgenyAlexandrov, IgorBarberis, DarioCanali, LucaCherepanova, ElizavetaFernandez Casani, AlvaroGarcia Montoro, CarlosGonzalez De La Hoz, SantiagoIakovlev, AlexanderProkoshin, FedorSalt, JoseSanchez Martinez, Francisco JavierRybkin, GrigoriVillaplana, MiguelDeployment and Operation of the ATLAS EventIndex for LHC Run 3Particle Physics - ExperimentThe ATLAS EventIndex is the global catalogue of all ATLAS real and simulated events. During the LHC long shutdown between Run 2 (2015-2018) and Run 3 (2022-2025) all its components were substantially revised and a new system was deployed for the start of Run 3 in Spring 2022. The new core storage system, based on HBase tables with a Phoenix interface rather than HDFS MapFiles, allows much faster data ingestion rates and scales much better than the old one to the data rates expected for the end of Run 3 and beyond. All user interfaces were also revised and a new command-line interface and web services were also deployed. The new system was initially populated with all existing data relative to Run 1 and Run 2 datasets, and then put online to receive Run 3 data in real time. After extensive testing, the old system, which ran in parallel to the new one for a few months, was finally switched off in October 2022. This paper describes the new system, the move of all existing data from the old to the new storage schemas and the operational experience gathered so far.ATL-SOFT-PROC-2023-027oai:cds.cern.ch:28703462023-09-14 |
spellingShingle | Particle Physics - Experiment Gallas, Elizabeth Alexandrov, Evgeny Alexandrov, Igor Barberis, Dario Canali, Luca Cherepanova, Elizaveta Fernandez Casani, Alvaro Garcia Montoro, Carlos Gonzalez De La Hoz, Santiago Iakovlev, Alexander Prokoshin, Fedor Salt, Jose Sanchez Martinez, Francisco Javier Rybkin, Grigori Villaplana, Miguel Deployment and Operation of the ATLAS EventIndex for LHC Run 3 |
title | Deployment and Operation of the ATLAS EventIndex for LHC Run 3 |
title_full | Deployment and Operation of the ATLAS EventIndex for LHC Run 3 |
title_fullStr | Deployment and Operation of the ATLAS EventIndex for LHC Run 3 |
title_full_unstemmed | Deployment and Operation of the ATLAS EventIndex for LHC Run 3 |
title_short | Deployment and Operation of the ATLAS EventIndex for LHC Run 3 |
title_sort | deployment and operation of the atlas eventindex for lhc run 3 |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2870346 |
work_keys_str_mv | AT gallaselizabeth deploymentandoperationoftheatlaseventindexforlhcrun3 AT alexandrovevgeny deploymentandoperationoftheatlaseventindexforlhcrun3 AT alexandrovigor deploymentandoperationoftheatlaseventindexforlhcrun3 AT barberisdario deploymentandoperationoftheatlaseventindexforlhcrun3 AT canaliluca deploymentandoperationoftheatlaseventindexforlhcrun3 AT cherepanovaelizaveta deploymentandoperationoftheatlaseventindexforlhcrun3 AT fernandezcasanialvaro deploymentandoperationoftheatlaseventindexforlhcrun3 AT garciamontorocarlos deploymentandoperationoftheatlaseventindexforlhcrun3 AT gonzalezdelahozsantiago deploymentandoperationoftheatlaseventindexforlhcrun3 AT iakovlevalexander deploymentandoperationoftheatlaseventindexforlhcrun3 AT prokoshinfedor deploymentandoperationoftheatlaseventindexforlhcrun3 AT saltjose deploymentandoperationoftheatlaseventindexforlhcrun3 AT sanchezmartinezfranciscojavier deploymentandoperationoftheatlaseventindexforlhcrun3 AT rybkingrigori deploymentandoperationoftheatlaseventindexforlhcrun3 AT villaplanamiguel deploymentandoperationoftheatlaseventindexforlhcrun3 |