Cargando…

JAliEn: the new ALICE high-performance and high-scalability Grid framework

The ALICE experiment will undergo extensive hardware and software upgrades for the LHC Run3. This translates in significant increase of the CPU and storage resources required for data processing, and at the same time the data access rates will grow linearly with the amount of resources. JAliEn (Java...

Descripción completa

Detalles Bibliográficos
Autores principales: Martinez Pedreira, M, Grigoras, C, Yurchenko, V
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921403037
http://cds.cern.ch/record/2701497
_version_ 1780964598628745216
author Martinez Pedreira, M
Grigoras, C
Yurchenko, V
author_facet Martinez Pedreira, M
Grigoras, C
Yurchenko, V
author_sort Martinez Pedreira, M
collection CERN
description The ALICE experiment will undergo extensive hardware and software upgrades for the LHC Run3. This translates in significant increase of the CPU and storage resources required for data processing, and at the same time the data access rates will grow linearly with the amount of resources. JAliEn (Java ALICE Environment) is the new Grid middleware designed to scale-out horizontally to fulfil the computing needs of the upgrade, and at the same time to modernize all parts of the distributed system software. This paper will present the architecture of the JAliEn framework, the technologies used and performance measurements. This work will also describe the next generation solution that will replace our main database backend, the AliEn File Catalogue. The catalogue is an integral part of the system, containing the metadata of all files written to the distributed Grid storage and also provides powerful search and data manipulation tools. As for JAliEn, the focus has been put onto horizontal scalability, with the aim to handle near exascale data volumes and order of magnitude more workload than the currently used Grid middleware. Lastly, this contribution will present how JAliEn manages the increased complexity of the tasks associated with the new ALICE data processing and analysis framework (ALFA) and multi-core environments.
id oai-inspirehep.net-1760935
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling oai-inspirehep.net-17609352022-08-10T12:27:29Zdoi:10.1051/epjconf/201921403037http://cds.cern.ch/record/2701497engMartinez Pedreira, MGrigoras, CYurchenko, VJAliEn: the new ALICE high-performance and high-scalability Grid frameworkComputing and ComputersThe ALICE experiment will undergo extensive hardware and software upgrades for the LHC Run3. This translates in significant increase of the CPU and storage resources required for data processing, and at the same time the data access rates will grow linearly with the amount of resources. JAliEn (Java ALICE Environment) is the new Grid middleware designed to scale-out horizontally to fulfil the computing needs of the upgrade, and at the same time to modernize all parts of the distributed system software. This paper will present the architecture of the JAliEn framework, the technologies used and performance measurements. This work will also describe the next generation solution that will replace our main database backend, the AliEn File Catalogue. The catalogue is an integral part of the system, containing the metadata of all files written to the distributed Grid storage and also provides powerful search and data manipulation tools. As for JAliEn, the focus has been put onto horizontal scalability, with the aim to handle near exascale data volumes and order of magnitude more workload than the currently used Grid middleware. Lastly, this contribution will present how JAliEn manages the increased complexity of the tasks associated with the new ALICE data processing and analysis framework (ALFA) and multi-core environments.oai:inspirehep.net:17609352019
spellingShingle Computing and Computers
Martinez Pedreira, M
Grigoras, C
Yurchenko, V
JAliEn: the new ALICE high-performance and high-scalability Grid framework
title JAliEn: the new ALICE high-performance and high-scalability Grid framework
title_full JAliEn: the new ALICE high-performance and high-scalability Grid framework
title_fullStr JAliEn: the new ALICE high-performance and high-scalability Grid framework
title_full_unstemmed JAliEn: the new ALICE high-performance and high-scalability Grid framework
title_short JAliEn: the new ALICE high-performance and high-scalability Grid framework
title_sort jalien: the new alice high-performance and high-scalability grid framework
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/201921403037
http://cds.cern.ch/record/2701497
work_keys_str_mv AT martinezpedreiram jalienthenewalicehighperformanceandhighscalabilitygridframework
AT grigorasc jalienthenewalicehighperformanceandhighscalabilitygridframework
AT yurchenkov jalienthenewalicehighperformanceandhighscalabilitygridframework