Cargando…

Optimizing High-Latency I/O in CMSSW

To efficiently read data over high-latency connections, ROOT-based applications must pay careful attention to user-level usage patterns and the configuration of the I/O layer. Starting in 2010, CMSSW began using and improving several ROOT best practice techniques such as enabling the TTreeCache obj...

Descripción completa

Detalles Bibliográficos
Autor principal: Bockelman, Brian Paul
Lenguaje:eng
Publicado: 2013
Materias:
Acceso en línea:http://cds.cern.ch/record/1626817
_version_ 1780933801801678848
author Bockelman, Brian Paul
author_facet Bockelman, Brian Paul
author_sort Bockelman, Brian Paul
collection CERN
description To efficiently read data over high-latency connections, ROOT-based applications must pay careful attention to user-level usage patterns and the configuration of the I/O layer. Starting in 2010, CMSSW began using and improving several ROOT best practice techniques such as enabling the TTreeCache object and avoiding reading events out-of-order. Since then, CMS has been deploying additional improvements not part of base ROOT, such as the removal of the TTreeCache startup penalty and significantly reducing the number of network roundtrips for sparse event filtering. CMS has also implemented an algorithm for multi-source reads using Xrootd. This new client layer splits ROOT read requests between active source servers based on recent server performance and issues these requests in parallel.
id cern-1626817
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2013
record_format invenio
spelling cern-16268172019-09-30T06:29:59Zhttp://cds.cern.ch/record/1626817engBockelman, Brian PaulOptimizing High-Latency I/O in CMSSWDetectors and Experimental TechniquesTo efficiently read data over high-latency connections, ROOT-based applications must pay careful attention to user-level usage patterns and the configuration of the I/O layer. Starting in 2010, CMSSW began using and improving several ROOT best practice techniques such as enabling the TTreeCache object and avoiding reading events out-of-order. Since then, CMS has been deploying additional improvements not part of base ROOT, such as the removal of the TTreeCache startup penalty and significantly reducing the number of network roundtrips for sparse event filtering. CMS has also implemented an algorithm for multi-source reads using Xrootd. This new client layer splits ROOT read requests between active source servers based on recent server performance and issues these requests in parallel.CMS-CR-2013-381oai:cds.cern.ch:16268172013-10-29
spellingShingle Detectors and Experimental Techniques
Bockelman, Brian Paul
Optimizing High-Latency I/O in CMSSW
title Optimizing High-Latency I/O in CMSSW
title_full Optimizing High-Latency I/O in CMSSW
title_fullStr Optimizing High-Latency I/O in CMSSW
title_full_unstemmed Optimizing High-Latency I/O in CMSSW
title_short Optimizing High-Latency I/O in CMSSW
title_sort optimizing high-latency i/o in cmssw
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1626817
work_keys_str_mv AT bockelmanbrianpaul optimizinghighlatencyioincmssw