Understanding IO patterns and performance of CMS Data Analysis across T2s worldwide

We discuss the IO patterns and performance of CMS Data Analysis based on measurements on "the bench" as well as operational observations during the initial LHC data taking period. It was observed the default I/O settings for CMS data analysis resulted in poor CPU efficiency and high I/O lo...

Descripción completa

Detalles Bibliográficos
Autor principal: Sala, Leonardo
Lenguaje:eng
Publicado: 2010
Materias:
Detectors and Experimental Techniques
Acceso en línea:http://cds.cern.ch/record/1328336
_version_ 1780921697742880768
author Sala, Leonardo
author_facet Sala, Leonardo
author_sort Sala, Leonardo
collection CERN
description We discuss the IO patterns and performance of CMS Data Analysis based on measurements on "the bench" as well as operational observations during the initial LHC data taking period. It was observed the default I/O settings for CMS data analysis resulted in poor CPU efficiency and high I/O load at many T2 sites. This effort developed tools to measure CMSSW I/O performance for grid-based analysis. Our work enabled CMSSW developers to understand how new I/O strategies work across the full range of deployed T2 storage solutions. We discuss our results, based upon aggregate I/O statistics collected worldwide.
id cern-1328336
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2010
record_format invenio
spelling cern-13283362019-09-30T06:29:59Zhttp://cds.cern.ch/record/1328336engSala, LeonardoUnderstanding IO patterns and performance of CMS Data Analysis across T2s worldwideDetectors and Experimental TechniquesWe discuss the IO patterns and performance of CMS Data Analysis based on measurements on "the bench" as well as operational observations during the initial LHC data taking period. It was observed the default I/O settings for CMS data analysis resulted in poor CPU efficiency and high I/O load at many T2 sites. This effort developed tools to measure CMSSW I/O performance for grid-based analysis. Our work enabled CMSSW developers to understand how new I/O strategies work across the full range of deployed T2 storage solutions. We discuss our results, based upon aggregate I/O statistics collected worldwide.CMS-CR-2010-221oai:cds.cern.ch:13283362010-11-15
spellingShingle Detectors and Experimental Techniques
Sala, Leonardo
Understanding IO patterns and performance of CMS Data Analysis across T2s worldwide
title Understanding IO patterns and performance of CMS Data Analysis across T2s worldwide
title_full Understanding IO patterns and performance of CMS Data Analysis across T2s worldwide
title_fullStr Understanding IO patterns and performance of CMS Data Analysis across T2s worldwide
title_full_unstemmed Understanding IO patterns and performance of CMS Data Analysis across T2s worldwide
title_short Understanding IO patterns and performance of CMS Data Analysis across T2s worldwide
title_sort understanding io patterns and performance of cms data analysis across t2s worldwide
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1328336
work_keys_str_mv AT salaleonardo understandingiopatternsandperformanceofcmsdataanalysisacrosst2sworldwide

Ejemplares similares