Cargando…
JAliEn: the new ALICE high-performance and high-scalability Grid framework
The ALICE experiment will undergo extensive hardware and software upgrades for the LHC Run3. This translates in significant increase of the CPU and storage resources required for data processing, and at the same time the data access rates will grow linearly with the amount of resources. JAliEn (Java...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2019
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/201921403037 http://cds.cern.ch/record/2701497 |
_version_ | 1780964598628745216 |
---|---|
author | Martinez Pedreira, M Grigoras, C Yurchenko, V |
author_facet | Martinez Pedreira, M Grigoras, C Yurchenko, V |
author_sort | Martinez Pedreira, M |
collection | CERN |
description | The ALICE experiment will undergo extensive hardware and software upgrades for the LHC Run3. This translates in significant increase of the CPU and storage resources required for data processing, and at the same time the data access rates will grow linearly with the amount of resources. JAliEn (Java ALICE Environment) is the new Grid middleware designed to scale-out horizontally to fulfil the computing needs of the upgrade, and at the same time to modernize all parts of the distributed system software. This paper will present the architecture of the JAliEn framework, the technologies used and performance measurements. This work will also describe the next generation solution that will replace our main database backend, the AliEn File Catalogue. The catalogue is an integral part of the system, containing the metadata of all files written to the distributed Grid storage and also provides powerful search and data manipulation tools. As for JAliEn, the focus has been put onto horizontal scalability, with the aim to handle near exascale data volumes and order of magnitude more workload than the currently used Grid middleware. Lastly, this contribution will present how JAliEn manages the increased complexity of the tasks associated with the new ALICE data processing and analysis framework (ALFA) and multi-core environments. |
id | oai-inspirehep.net-1760935 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2019 |
record_format | invenio |
spelling | oai-inspirehep.net-17609352022-08-10T12:27:29Zdoi:10.1051/epjconf/201921403037http://cds.cern.ch/record/2701497engMartinez Pedreira, MGrigoras, CYurchenko, VJAliEn: the new ALICE high-performance and high-scalability Grid frameworkComputing and ComputersThe ALICE experiment will undergo extensive hardware and software upgrades for the LHC Run3. This translates in significant increase of the CPU and storage resources required for data processing, and at the same time the data access rates will grow linearly with the amount of resources. JAliEn (Java ALICE Environment) is the new Grid middleware designed to scale-out horizontally to fulfil the computing needs of the upgrade, and at the same time to modernize all parts of the distributed system software. This paper will present the architecture of the JAliEn framework, the technologies used and performance measurements. This work will also describe the next generation solution that will replace our main database backend, the AliEn File Catalogue. The catalogue is an integral part of the system, containing the metadata of all files written to the distributed Grid storage and also provides powerful search and data manipulation tools. As for JAliEn, the focus has been put onto horizontal scalability, with the aim to handle near exascale data volumes and order of magnitude more workload than the currently used Grid middleware. Lastly, this contribution will present how JAliEn manages the increased complexity of the tasks associated with the new ALICE data processing and analysis framework (ALFA) and multi-core environments.oai:inspirehep.net:17609352019 |
spellingShingle | Computing and Computers Martinez Pedreira, M Grigoras, C Yurchenko, V JAliEn: the new ALICE high-performance and high-scalability Grid framework |
title | JAliEn: the new ALICE high-performance and high-scalability Grid framework |
title_full | JAliEn: the new ALICE high-performance and high-scalability Grid framework |
title_fullStr | JAliEn: the new ALICE high-performance and high-scalability Grid framework |
title_full_unstemmed | JAliEn: the new ALICE high-performance and high-scalability Grid framework |
title_short | JAliEn: the new ALICE high-performance and high-scalability Grid framework |
title_sort | jalien: the new alice high-performance and high-scalability grid framework |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/201921403037 http://cds.cern.ch/record/2701497 |
work_keys_str_mv | AT martinezpedreiram jalienthenewalicehighperformanceandhighscalabilitygridframework AT grigorasc jalienthenewalicehighperformanceandhighscalabilitygridframework AT yurchenkov jalienthenewalicehighperformanceandhighscalabilitygridframework |