Cargando…

Multi-threaded Output in CMS using ROOT

CMS has worked aggressively to make use of multi-core architectures, routinely running 4 to 8 core production jobs in 2017. The primary impediment to efficiently scaling beyond 8 cores has been our ROOT-based output module, which has been necessarily single threaded. In this paper we explore the c...

Descripción completa

Detalles Bibliográficos
Autor principal: Riley, Daniel
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:http://cds.cern.ch/record/2648951
_version_ 1780960707162931200
author Riley, Daniel
author_facet Riley, Daniel
author_sort Riley, Daniel
collection CERN
description CMS has worked aggressively to make use of multi-core architectures, routinely running 4 to 8 core production jobs in 2017. The primary impediment to efficiently scaling beyond 8 cores has been our ROOT-based output module, which has been necessarily single threaded. In this paper we explore the changes made to the CMS framework and our ROOT output module to overcome the previous scaling limits, using two new ROOT features the TBufferMerger asynchronous file merger, and Implicit Multi-Threading. We examine the architecture of the new parallel output module, the specific accommodations and modifications that were made to ensure compatibility with the CMS framework scheduler, and the performance characteristics of the new output module.
id cern-2648951
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26489512019-09-30T06:29:59Zhttp://cds.cern.ch/record/2648951engRiley, DanielMulti-threaded Output in CMS using ROOTDetectors and Experimental TechniquesCMS has worked aggressively to make use of multi-core architectures, routinely running 4 to 8 core production jobs in 2017. The primary impediment to efficiently scaling beyond 8 cores has been our ROOT-based output module, which has been necessarily single threaded. In this paper we explore the changes made to the CMS framework and our ROOT output module to overcome the previous scaling limits, using two new ROOT features the TBufferMerger asynchronous file merger, and Implicit Multi-Threading. We examine the architecture of the new parallel output module, the specific accommodations and modifications that were made to ensure compatibility with the CMS framework scheduler, and the performance characteristics of the new output module.CMS-CR-2018-289oai:cds.cern.ch:26489512018-10-18
spellingShingle Detectors and Experimental Techniques
Riley, Daniel
Multi-threaded Output in CMS using ROOT
title Multi-threaded Output in CMS using ROOT
title_full Multi-threaded Output in CMS using ROOT
title_fullStr Multi-threaded Output in CMS using ROOT
title_full_unstemmed Multi-threaded Output in CMS using ROOT
title_short Multi-threaded Output in CMS using ROOT
title_sort multi-threaded output in cms using root
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/2648951
work_keys_str_mv AT rileydaniel multithreadedoutputincmsusingroot