Cargando…
The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of o...
| Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Lenguaje: | eng |
| Publicado: |
2022
|
| Materias: | |
| Acceso en línea: | https://dx.doi.org/10.1007/s41781-023-00096-8 http://cds.cern.ch/record/2847460 |
| _version_ | 1780976778242686976 |
|---|---|
| author | Barberis, Dario Aleksandrov, Igor Alexandrov, Evgeny Baranowski, Zbigniew Canali, Luca Cherepanova, Elizaveta Dimitrov, Gancho Favareto, Andrea Casani, Alvaro Fernandez Gallas, Elizabeth J. Montoro, Carlos Garcia de la Hoz, Santiago Gonzalez Hrivnac, Julius Iakovlev, Alexander Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Salt, Jose Sanchez, Javier Sorokoletov, Roman Toebbicke, Rainer Vasileva, Petya Villaplana Perez, Miguel Yuan, Ruijun |
| author_facet | Barberis, Dario Aleksandrov, Igor Alexandrov, Evgeny Baranowski, Zbigniew Canali, Luca Cherepanova, Elizaveta Dimitrov, Gancho Favareto, Andrea Casani, Alvaro Fernandez Gallas, Elizabeth J. Montoro, Carlos Garcia de la Hoz, Santiago Gonzalez Hrivnac, Julius Iakovlev, Alexander Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Salt, Jose Sanchez, Javier Sorokoletov, Roman Toebbicke, Rainer Vasileva, Petya Villaplana Perez, Miguel Yuan, Ruijun |
| author_sort | Barberis, Dario |
| collection | CERN |
| description | The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of operation, processes them for analysis and generates even larger simulated data samples; a global catalogue is needed to keep track of the location of each event record and be able to search and retrieve specific events for in-depth investigations. Each EventIndex record includes summary information on the event itself and the pointers to the files containing the full event. Most components of the EventIndex system are implemented using BigData free and open-source software. This paper describes the architectural choices and their evolution in time, as well as the past, current and foreseen future implementations of all EventIndex components. |
| id | cern-2847460 |
| institution | Organización Europea para la Investigación Nuclear |
| language | eng |
| publishDate | 2022 |
| record_format | invenio |
| spelling | cern-28474602023-03-23T15:41:28Zdoi:10.1007/s41781-023-00096-8http://cds.cern.ch/record/2847460engBarberis, DarioAleksandrov, IgorAlexandrov, EvgenyBaranowski, ZbigniewCanali, LucaCherepanova, ElizavetaDimitrov, GanchoFavareto, AndreaCasani, Alvaro FernandezGallas, Elizabeth J.Montoro, Carlos Garciade la Hoz, Santiago GonzalezHrivnac, JuliusIakovlev, AlexanderKazymov, AndreiMineev, MikhailProkoshin, FedorRybkin, GrigoriSalt, JoseSanchez, JavierSorokoletov, RomanToebbicke, RainerVasileva, PetyaVillaplana Perez, MiguelYuan, RuijunThe ATLAS EventIndex: a BigData catalogue for all ATLAS experiment eventshep-exParticle Physics - Experimentcs.DCComputing and ComputersThe ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of operation, processes them for analysis and generates even larger simulated data samples; a global catalogue is needed to keep track of the location of each event record and be able to search and retrieve specific events for in-depth investigations. Each EventIndex record includes summary information on the event itself and the pointers to the files containing the full event. Most components of the EventIndex system are implemented using BigData free and open-source software. This paper describes the architectural choices and their evolution in time, as well as the past, current and foreseen future implementations of all EventIndex components.The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of operation, processes them for analysis and generates even larger simulated data samples; a global catalogue is needed to keep track of the location of each event record and be able to search and retrieve specific events for in-depth investigations. Each EventIndex record includes summary information on the event itself and the pointers to the files containing the full event. Most components of the EventIndex system are implemented using BigData open-source tools. This paper describes the architectural choices and their evolution in time, as well as the past, current and foreseen future implementations of all EventIndex components.arXiv:2211.08293oai:cds.cern.ch:28474602022-11-15 |
| spellingShingle | hep-ex Particle Physics - Experiment cs.DC Computing and Computers Barberis, Dario Aleksandrov, Igor Alexandrov, Evgeny Baranowski, Zbigniew Canali, Luca Cherepanova, Elizaveta Dimitrov, Gancho Favareto, Andrea Casani, Alvaro Fernandez Gallas, Elizabeth J. Montoro, Carlos Garcia de la Hoz, Santiago Gonzalez Hrivnac, Julius Iakovlev, Alexander Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Salt, Jose Sanchez, Javier Sorokoletov, Roman Toebbicke, Rainer Vasileva, Petya Villaplana Perez, Miguel Yuan, Ruijun The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
| title | The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
| title_full | The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
| title_fullStr | The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
| title_full_unstemmed | The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
| title_short | The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
| title_sort | atlas eventindex: a bigdata catalogue for all atlas experiment events |
| topic | hep-ex Particle Physics - Experiment cs.DC Computing and Computers |
| url | https://dx.doi.org/10.1007/s41781-023-00096-8 http://cds.cern.ch/record/2847460 |
| work_keys_str_mv | AT barberisdario theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT aleksandrovigor theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT alexandrovevgeny theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT baranowskizbigniew theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT canaliluca theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT cherepanovaelizaveta theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT dimitrovgancho theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT favaretoandrea theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT casanialvarofernandez theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT gallaselizabethj theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT montorocarlosgarcia theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT delahozsantiagogonzalez theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT hrivnacjulius theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT iakovlevalexander theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT kazymovandrei theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT mineevmikhail theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT prokoshinfedor theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT rybkingrigori theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT saltjose theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT sanchezjavier theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT sorokoletovroman theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT toebbickerainer theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT vasilevapetya theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT villaplanaperezmiguel theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT yuanruijun theatlaseventindexabigdatacatalogueforallatlasexperimentevents AT barberisdario atlaseventindexabigdatacatalogueforallatlasexperimentevents AT aleksandrovigor atlaseventindexabigdatacatalogueforallatlasexperimentevents AT alexandrovevgeny atlaseventindexabigdatacatalogueforallatlasexperimentevents AT baranowskizbigniew atlaseventindexabigdatacatalogueforallatlasexperimentevents AT canaliluca atlaseventindexabigdatacatalogueforallatlasexperimentevents AT cherepanovaelizaveta atlaseventindexabigdatacatalogueforallatlasexperimentevents AT dimitrovgancho atlaseventindexabigdatacatalogueforallatlasexperimentevents AT favaretoandrea atlaseventindexabigdatacatalogueforallatlasexperimentevents AT casanialvarofernandez atlaseventindexabigdatacatalogueforallatlasexperimentevents AT gallaselizabethj atlaseventindexabigdatacatalogueforallatlasexperimentevents AT montorocarlosgarcia atlaseventindexabigdatacatalogueforallatlasexperimentevents AT delahozsantiagogonzalez atlaseventindexabigdatacatalogueforallatlasexperimentevents AT hrivnacjulius atlaseventindexabigdatacatalogueforallatlasexperimentevents AT iakovlevalexander atlaseventindexabigdatacatalogueforallatlasexperimentevents AT kazymovandrei atlaseventindexabigdatacatalogueforallatlasexperimentevents AT mineevmikhail atlaseventindexabigdatacatalogueforallatlasexperimentevents AT prokoshinfedor atlaseventindexabigdatacatalogueforallatlasexperimentevents AT rybkingrigori atlaseventindexabigdatacatalogueforallatlasexperimentevents AT saltjose atlaseventindexabigdatacatalogueforallatlasexperimentevents AT sanchezjavier atlaseventindexabigdatacatalogueforallatlasexperimentevents AT sorokoletovroman atlaseventindexabigdatacatalogueforallatlasexperimentevents AT toebbickerainer atlaseventindexabigdatacatalogueforallatlasexperimentevents AT vasilevapetya atlaseventindexabigdatacatalogueforallatlasexperimentevents AT villaplanaperezmiguel atlaseventindexabigdatacatalogueforallatlasexperimentevents AT yuanruijun atlaseventindexabigdatacatalogueforallatlasexperimentevents |