Cargando…
Expressing parallelism with ROOT
The need for processing the ever-increasing amount of data generated by the LHC experiments in a more efficient way has motivated ROOT to further develop its support for parallelism. Such support is being tackled both for shared-memory and distributed-memory environments. The incarnations of the afo...
Autores principales: | , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2017
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/898/7/072022 http://cds.cern.ch/record/2296792 |
_version_ | 1780956904740093952 |
---|---|
author | Piparo, D Tejedor, E Guiraud, E Ganis, G Mato, P Moneta, L Valls Pla, X Canal, P |
author_facet | Piparo, D Tejedor, E Guiraud, E Ganis, G Mato, P Moneta, L Valls Pla, X Canal, P |
author_sort | Piparo, D |
collection | CERN |
description | The need for processing the ever-increasing amount of data generated by the LHC experiments in a more efficient way has motivated ROOT to further develop its support for parallelism. Such support is being tackled both for shared-memory and distributed-memory environments. The incarnations of the aforementioned parallelism are multi-threading, multi-processing and cluster-wide executions. In the area of multi-threading, we discuss the new implicit parallelism and related interfaces, as well as the new building blocks to safely operate with ROOT objects in a multi-threaded environment. Regarding multi-processing, we review the new MultiProc framework, comparing it with similar tools (e.g. multiprocessing module in Python). Finally, as an alternative to PROOF for cluster-wide executions, we introduce the efforts on integrating ROOT with state-of-the-art distributed data processing technologies like Spark, both in terms of programming model and runtime design (with EOS as one of the main components). For all the levels of parallelism, we discuss, based on real-life examples and measurements, how our proposals can increase the productivity of scientists. |
id | oai-inspirehep.net-1638554 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2017 |
record_format | invenio |
spelling | oai-inspirehep.net-16385542021-02-09T10:06:25Zdoi:10.1088/1742-6596/898/7/072022http://cds.cern.ch/record/2296792engPiparo, DTejedor, EGuiraud, EGanis, GMato, PMoneta, LValls Pla, XCanal, PExpressing parallelism with ROOTComputing and ComputersThe need for processing the ever-increasing amount of data generated by the LHC experiments in a more efficient way has motivated ROOT to further develop its support for parallelism. Such support is being tackled both for shared-memory and distributed-memory environments. The incarnations of the aforementioned parallelism are multi-threading, multi-processing and cluster-wide executions. In the area of multi-threading, we discuss the new implicit parallelism and related interfaces, as well as the new building blocks to safely operate with ROOT objects in a multi-threaded environment. Regarding multi-processing, we review the new MultiProc framework, comparing it with similar tools (e.g. multiprocessing module in Python). Finally, as an alternative to PROOF for cluster-wide executions, we introduce the efforts on integrating ROOT with state-of-the-art distributed data processing technologies like Spark, both in terms of programming model and runtime design (with EOS as one of the main components). For all the levels of parallelism, we discuss, based on real-life examples and measurements, how our proposals can increase the productivity of scientists.FERMILAB-CONF-16-738-CDoai:inspirehep.net:16385542017 |
spellingShingle | Computing and Computers Piparo, D Tejedor, E Guiraud, E Ganis, G Mato, P Moneta, L Valls Pla, X Canal, P Expressing parallelism with ROOT |
title | Expressing parallelism with ROOT |
title_full | Expressing parallelism with ROOT |
title_fullStr | Expressing parallelism with ROOT |
title_full_unstemmed | Expressing parallelism with ROOT |
title_short | Expressing parallelism with ROOT |
title_sort | expressing parallelism with root |
topic | Computing and Computers |
url | https://dx.doi.org/10.1088/1742-6596/898/7/072022 http://cds.cern.ch/record/2296792 |
work_keys_str_mv | AT piparod expressingparallelismwithroot AT tejedore expressingparallelismwithroot AT guiraude expressingparallelismwithroot AT ganisg expressingparallelismwithroot AT matop expressingparallelismwithroot AT monetal expressingparallelismwithroot AT vallsplax expressingparallelismwithroot AT canalp expressingparallelismwithroot |