Cargando…

CMS Data Transfer operations after the first years of LHC collisions

<!--HTML-->CMS experiment possesses distributed computing infrastructure and its performance heavily depends on the fast and smooth distribution of data between different CMS sites. Data must be transferred from the Tier-0 (CERN) to the Tier-1 for storing and archiving, and time and good quali...

Descripción completa

Detalles Bibliográficos
Autor principal: Kaselis, Rapolas
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1460583
_version_ 1780925241067831296
author Kaselis, Rapolas
author_facet Kaselis, Rapolas
author_sort Kaselis, Rapolas
collection CERN
description <!--HTML-->CMS experiment possesses distributed computing infrastructure and its performance heavily depends on the fast and smooth distribution of data between different CMS sites. Data must be transferred from the Tier-0 (CERN) to the Tier-1 for storing and archiving, and time and good quality are vital to avoid overflowing CERN storage buffers. At the same time, processed data has to be distributed from Tier-1 sites to all Tier-2 sites for physics analysis while MonteCarlo simulations synchronized back to Tier-1 sites for further archival. At the core of all transferring machinery is PhEDEx (Physics Experiment Data Export) data transfer system. It is very important to ensure reliable operation of the system, and the operational tasks comprise monitoring and debugging all transfer issues. Based on transfer quality information Site Readiness tool is used to create plans for resources utilization in the future. We review the operational procedures created to enforce reliable data delivery to CMS distributed sites all over the world. Additionally, we need to keep data consistent at all sites and both on disk and on tape. In this presentation, we describe the principles and actions taken to keep data consistent on sites storage systems and central CMS Data Replication Database (TMDB/DBS) while ensuring fast and reliable data samples delivery of hundreds of terabytes to the entire CMS physics community.
id cern-1460583
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14605832022-11-02T22:23:45Zhttp://cds.cern.ch/record/1460583engKaselis, RapolasCMS Data Transfer operations after the first years of LHC collisionsComputing in High Energy and Nuclear Physics (CHEP) 2012Conferences<!--HTML-->CMS experiment possesses distributed computing infrastructure and its performance heavily depends on the fast and smooth distribution of data between different CMS sites. Data must be transferred from the Tier-0 (CERN) to the Tier-1 for storing and archiving, and time and good quality are vital to avoid overflowing CERN storage buffers. At the same time, processed data has to be distributed from Tier-1 sites to all Tier-2 sites for physics analysis while MonteCarlo simulations synchronized back to Tier-1 sites for further archival. At the core of all transferring machinery is PhEDEx (Physics Experiment Data Export) data transfer system. It is very important to ensure reliable operation of the system, and the operational tasks comprise monitoring and debugging all transfer issues. Based on transfer quality information Site Readiness tool is used to create plans for resources utilization in the future. We review the operational procedures created to enforce reliable data delivery to CMS distributed sites all over the world. Additionally, we need to keep data consistent at all sites and both on disk and on tape. In this presentation, we describe the principles and actions taken to keep data consistent on sites storage systems and central CMS Data Replication Database (TMDB/DBS) while ensuring fast and reliable data samples delivery of hundreds of terabytes to the entire CMS physics community.oai:cds.cern.ch:14605832012
spellingShingle Conferences
Kaselis, Rapolas
CMS Data Transfer operations after the first years of LHC collisions
title CMS Data Transfer operations after the first years of LHC collisions
title_full CMS Data Transfer operations after the first years of LHC collisions
title_fullStr CMS Data Transfer operations after the first years of LHC collisions
title_full_unstemmed CMS Data Transfer operations after the first years of LHC collisions
title_short CMS Data Transfer operations after the first years of LHC collisions
title_sort cms data transfer operations after the first years of lhc collisions
topic Conferences
url http://cds.cern.ch/record/1460583
work_keys_str_mv AT kaselisrapolas cmsdatatransferoperationsafterthefirstyearsoflhccollisions
AT kaselisrapolas computinginhighenergyandnuclearphysicschep2012