Cargando…

Expressing parallelism with ROOT

The need for processing the ever-increasing amount of data generated by the LHC experiments in a more efficient way has motivated ROOT to further develop its support for parallelism. Such support is being tackled both for shared-memory and distributed-memory environments. The incarnations of the afo...

Descripción completa

Detalles Bibliográficos
Autores principales: Piparo, D, Tejedor, E, Guiraud, E, Ganis, G, Mato, P, Moneta, L, Valls Pla, X, Canal, P
Lenguaje:eng
Publicado: 2017
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/898/7/072022
http://cds.cern.ch/record/2296792
_version_ 1780956904740093952
author Piparo, D
Tejedor, E
Guiraud, E
Ganis, G
Mato, P
Moneta, L
Valls Pla, X
Canal, P
author_facet Piparo, D
Tejedor, E
Guiraud, E
Ganis, G
Mato, P
Moneta, L
Valls Pla, X
Canal, P
author_sort Piparo, D
collection CERN
description The need for processing the ever-increasing amount of data generated by the LHC experiments in a more efficient way has motivated ROOT to further develop its support for parallelism. Such support is being tackled both for shared-memory and distributed-memory environments. The incarnations of the aforementioned parallelism are multi-threading, multi-processing and cluster-wide executions. In the area of multi-threading, we discuss the new implicit parallelism and related interfaces, as well as the new building blocks to safely operate with ROOT objects in a multi-threaded environment. Regarding multi-processing, we review the new MultiProc framework, comparing it with similar tools (e.g. multiprocessing module in Python). Finally, as an alternative to PROOF for cluster-wide executions, we introduce the efforts on integrating ROOT with state-of-the-art distributed data processing technologies like Spark, both in terms of programming model and runtime design (with EOS as one of the main components). For all the levels of parallelism, we discuss, based on real-life examples and measurements, how our proposals can increase the productivity of scientists.
id oai-inspirehep.net-1638554
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2017
record_format invenio
spelling oai-inspirehep.net-16385542021-02-09T10:06:25Zdoi:10.1088/1742-6596/898/7/072022http://cds.cern.ch/record/2296792engPiparo, DTejedor, EGuiraud, EGanis, GMato, PMoneta, LValls Pla, XCanal, PExpressing parallelism with ROOTComputing and ComputersThe need for processing the ever-increasing amount of data generated by the LHC experiments in a more efficient way has motivated ROOT to further develop its support for parallelism. Such support is being tackled both for shared-memory and distributed-memory environments. The incarnations of the aforementioned parallelism are multi-threading, multi-processing and cluster-wide executions. In the area of multi-threading, we discuss the new implicit parallelism and related interfaces, as well as the new building blocks to safely operate with ROOT objects in a multi-threaded environment. Regarding multi-processing, we review the new MultiProc framework, comparing it with similar tools (e.g. multiprocessing module in Python). Finally, as an alternative to PROOF for cluster-wide executions, we introduce the efforts on integrating ROOT with state-of-the-art distributed data processing technologies like Spark, both in terms of programming model and runtime design (with EOS as one of the main components). For all the levels of parallelism, we discuss, based on real-life examples and measurements, how our proposals can increase the productivity of scientists.FERMILAB-CONF-16-738-CDoai:inspirehep.net:16385542017
spellingShingle Computing and Computers
Piparo, D
Tejedor, E
Guiraud, E
Ganis, G
Mato, P
Moneta, L
Valls Pla, X
Canal, P
Expressing parallelism with ROOT
title Expressing parallelism with ROOT
title_full Expressing parallelism with ROOT
title_fullStr Expressing parallelism with ROOT
title_full_unstemmed Expressing parallelism with ROOT
title_short Expressing parallelism with ROOT
title_sort expressing parallelism with root
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/898/7/072022
http://cds.cern.ch/record/2296792
work_keys_str_mv AT piparod expressingparallelismwithroot
AT tejedore expressingparallelismwithroot
AT guiraude expressingparallelismwithroot
AT ganisg expressingparallelismwithroot
AT matop expressingparallelismwithroot
AT monetal expressingparallelismwithroot
AT vallsplax expressingparallelismwithroot
AT canalp expressingparallelismwithroot