Cargando…

Deployment and Operation of the ATLAS EventIndex for LHC Run 3

The ATLAS EventIndex is the global catalogue of all ATLAS real and simulated events. During the LHC long shutdown between Run 2 (2015-2018) and Run 3 (2022-2025) all its components were substantially revised and a new system was deployed for the start of Run 3 in Spring 2022. The new core storage sy...

Descripción completa

Detalles Bibliográficos
Autores principales: Gallas, Elizabeth, Alexandrov, Evgeny, Alexandrov, Igor, Barberis, Dario, Canali, Luca, Cherepanova, Elizaveta, Fernandez Casani, Alvaro, Garcia Montoro, Carlos, Gonzalez De La Hoz, Santiago, Iakovlev, Alexander, Prokoshin, Fedor, Salt, Jose, Sanchez Martinez, Francisco Javier, Rybkin, Grigori, Villaplana, Miguel
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2870346
_version_ 1780978329318326272
author Gallas, Elizabeth
Alexandrov, Evgeny
Alexandrov, Igor
Barberis, Dario
Canali, Luca
Cherepanova, Elizaveta
Fernandez Casani, Alvaro
Garcia Montoro, Carlos
Gonzalez De La Hoz, Santiago
Iakovlev, Alexander
Prokoshin, Fedor
Salt, Jose
Sanchez Martinez, Francisco Javier
Rybkin, Grigori
Villaplana, Miguel
author_facet Gallas, Elizabeth
Alexandrov, Evgeny
Alexandrov, Igor
Barberis, Dario
Canali, Luca
Cherepanova, Elizaveta
Fernandez Casani, Alvaro
Garcia Montoro, Carlos
Gonzalez De La Hoz, Santiago
Iakovlev, Alexander
Prokoshin, Fedor
Salt, Jose
Sanchez Martinez, Francisco Javier
Rybkin, Grigori
Villaplana, Miguel
author_sort Gallas, Elizabeth
collection CERN
description The ATLAS EventIndex is the global catalogue of all ATLAS real and simulated events. During the LHC long shutdown between Run 2 (2015-2018) and Run 3 (2022-2025) all its components were substantially revised and a new system was deployed for the start of Run 3 in Spring 2022. The new core storage system, based on HBase tables with a Phoenix interface rather than HDFS MapFiles, allows much faster data ingestion rates and scales much better than the old one to the data rates expected for the end of Run 3 and beyond. All user interfaces were also revised and a new command-line interface and web services were also deployed. The new system was initially populated with all existing data relative to Run 1 and Run 2 datasets, and then put online to receive Run 3 data in real time. After extensive testing, the old system, which ran in parallel to the new one for a few months, was finally switched off in October 2022. This paper describes the new system, the move of all existing data from the old to the new storage schemas and the operational experience gathered so far.
id cern-2870346
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28703462023-09-14T20:22:09Zhttp://cds.cern.ch/record/2870346engGallas, ElizabethAlexandrov, EvgenyAlexandrov, IgorBarberis, DarioCanali, LucaCherepanova, ElizavetaFernandez Casani, AlvaroGarcia Montoro, CarlosGonzalez De La Hoz, SantiagoIakovlev, AlexanderProkoshin, FedorSalt, JoseSanchez Martinez, Francisco JavierRybkin, GrigoriVillaplana, MiguelDeployment and Operation of the ATLAS EventIndex for LHC Run 3Particle Physics - ExperimentThe ATLAS EventIndex is the global catalogue of all ATLAS real and simulated events. During the LHC long shutdown between Run 2 (2015-2018) and Run 3 (2022-2025) all its components were substantially revised and a new system was deployed for the start of Run 3 in Spring 2022. The new core storage system, based on HBase tables with a Phoenix interface rather than HDFS MapFiles, allows much faster data ingestion rates and scales much better than the old one to the data rates expected for the end of Run 3 and beyond. All user interfaces were also revised and a new command-line interface and web services were also deployed. The new system was initially populated with all existing data relative to Run 1 and Run 2 datasets, and then put online to receive Run 3 data in real time. After extensive testing, the old system, which ran in parallel to the new one for a few months, was finally switched off in October 2022. This paper describes the new system, the move of all existing data from the old to the new storage schemas and the operational experience gathered so far.ATL-SOFT-PROC-2023-027oai:cds.cern.ch:28703462023-09-14
spellingShingle Particle Physics - Experiment
Gallas, Elizabeth
Alexandrov, Evgeny
Alexandrov, Igor
Barberis, Dario
Canali, Luca
Cherepanova, Elizaveta
Fernandez Casani, Alvaro
Garcia Montoro, Carlos
Gonzalez De La Hoz, Santiago
Iakovlev, Alexander
Prokoshin, Fedor
Salt, Jose
Sanchez Martinez, Francisco Javier
Rybkin, Grigori
Villaplana, Miguel
Deployment and Operation of the ATLAS EventIndex for LHC Run 3
title Deployment and Operation of the ATLAS EventIndex for LHC Run 3
title_full Deployment and Operation of the ATLAS EventIndex for LHC Run 3
title_fullStr Deployment and Operation of the ATLAS EventIndex for LHC Run 3
title_full_unstemmed Deployment and Operation of the ATLAS EventIndex for LHC Run 3
title_short Deployment and Operation of the ATLAS EventIndex for LHC Run 3
title_sort deployment and operation of the atlas eventindex for lhc run 3
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2870346
work_keys_str_mv AT gallaselizabeth deploymentandoperationoftheatlaseventindexforlhcrun3
AT alexandrovevgeny deploymentandoperationoftheatlaseventindexforlhcrun3
AT alexandrovigor deploymentandoperationoftheatlaseventindexforlhcrun3
AT barberisdario deploymentandoperationoftheatlaseventindexforlhcrun3
AT canaliluca deploymentandoperationoftheatlaseventindexforlhcrun3
AT cherepanovaelizaveta deploymentandoperationoftheatlaseventindexforlhcrun3
AT fernandezcasanialvaro deploymentandoperationoftheatlaseventindexforlhcrun3
AT garciamontorocarlos deploymentandoperationoftheatlaseventindexforlhcrun3
AT gonzalezdelahozsantiago deploymentandoperationoftheatlaseventindexforlhcrun3
AT iakovlevalexander deploymentandoperationoftheatlaseventindexforlhcrun3
AT prokoshinfedor deploymentandoperationoftheatlaseventindexforlhcrun3
AT saltjose deploymentandoperationoftheatlaseventindexforlhcrun3
AT sanchezmartinezfranciscojavier deploymentandoperationoftheatlaseventindexforlhcrun3
AT rybkingrigori deploymentandoperationoftheatlaseventindexforlhcrun3
AT villaplanamiguel deploymentandoperationoftheatlaseventindexforlhcrun3