Cargando…
Optimizing High-Latency I/O in CMSSW
To efficiently read data over high-latency connections, ROOT-based applications must pay careful attention to user-level usage patterns and the configuration of the I/O layer. Starting in 2010, CMSSW began using and improving several ROOT best practice techniques such as enabling the TTreeCache obj...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2013
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1626817 |
_version_ | 1780933801801678848 |
---|---|
author | Bockelman, Brian Paul |
author_facet | Bockelman, Brian Paul |
author_sort | Bockelman, Brian Paul |
collection | CERN |
description | To efficiently read data over high-latency connections, ROOT-based applications must pay careful attention to user-level usage patterns and the configuration of the I/O layer. Starting in 2010, CMSSW began using and improving several ROOT best practice techniques such as enabling the TTreeCache object and avoiding reading events out-of-order. Since then, CMS has been deploying additional improvements not part of base ROOT, such as the removal of the TTreeCache startup penalty and significantly reducing the number of network roundtrips for sparse event filtering. CMS has also implemented an algorithm for multi-source reads using Xrootd. This new client layer splits ROOT read requests between active source servers based on recent server performance and issues these requests in parallel. |
id | cern-1626817 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2013 |
record_format | invenio |
spelling | cern-16268172019-09-30T06:29:59Zhttp://cds.cern.ch/record/1626817engBockelman, Brian PaulOptimizing High-Latency I/O in CMSSWDetectors and Experimental TechniquesTo efficiently read data over high-latency connections, ROOT-based applications must pay careful attention to user-level usage patterns and the configuration of the I/O layer. Starting in 2010, CMSSW began using and improving several ROOT best practice techniques such as enabling the TTreeCache object and avoiding reading events out-of-order. Since then, CMS has been deploying additional improvements not part of base ROOT, such as the removal of the TTreeCache startup penalty and significantly reducing the number of network roundtrips for sparse event filtering. CMS has also implemented an algorithm for multi-source reads using Xrootd. This new client layer splits ROOT read requests between active source servers based on recent server performance and issues these requests in parallel.CMS-CR-2013-381oai:cds.cern.ch:16268172013-10-29 |
spellingShingle | Detectors and Experimental Techniques Bockelman, Brian Paul Optimizing High-Latency I/O in CMSSW |
title | Optimizing High-Latency I/O in CMSSW |
title_full | Optimizing High-Latency I/O in CMSSW |
title_fullStr | Optimizing High-Latency I/O in CMSSW |
title_full_unstemmed | Optimizing High-Latency I/O in CMSSW |
title_short | Optimizing High-Latency I/O in CMSSW |
title_sort | optimizing high-latency i/o in cmssw |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/1626817 |
work_keys_str_mv | AT bockelmanbrianpaul optimizinghighlatencyioincmssw |