Cargando…
Ensuring Data Consistency Over CMS Distributed Computing System
CMS utilizes a distributed infrastructure of computing centers to custodially store data, to provide organized processing resources, and to provide analysis computing resources for users. Integrated over the whole system, even in the first year of data taking, the available disk storage approaches 1...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2009
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1196115 |
_version_ | 1780917059060760576 |
---|---|
author | Rossman, Paul |
author_facet | Rossman, Paul |
author_sort | Rossman, Paul |
collection | CERN |
description | CMS utilizes a distributed infrastructure of computing centers to custodially store data, to provide organized processing resources, and to provide analysis computing resources for users. Integrated over the whole system, even in the first year of data taking, the available disk storage approaches 10 petabytes of space. Maintaining consistency between the data bookkeeping, the data transfer system, and physical storage is an interesting technical and operations challenge. In this paper we will discuss the CMS effort to ensure that data is consistently available at all computing centers. We will discuss the technical tools that monitor the consistency of the catalogs and the physical storage as well as the operations model used to find and solve inconsistencies. |
id | cern-1196115 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2009 |
record_format | invenio |
spelling | cern-11961152019-09-30T06:29:59Zhttp://cds.cern.ch/record/1196115engRossman, PaulEnsuring Data Consistency Over CMS Distributed Computing SystemDetectors and Experimental TechniquesCMS utilizes a distributed infrastructure of computing centers to custodially store data, to provide organized processing resources, and to provide analysis computing resources for users. Integrated over the whole system, even in the first year of data taking, the available disk storage approaches 10 petabytes of space. Maintaining consistency between the data bookkeeping, the data transfer system, and physical storage is an interesting technical and operations challenge. In this paper we will discuss the CMS effort to ensure that data is consistently available at all computing centers. We will discuss the technical tools that monitor the consistency of the catalogs and the physical storage as well as the operations model used to find and solve inconsistencies.CMS-CR-2009-110oai:cds.cern.ch:11961152009-05-15 |
spellingShingle | Detectors and Experimental Techniques Rossman, Paul Ensuring Data Consistency Over CMS Distributed Computing System |
title | Ensuring Data Consistency Over CMS Distributed Computing System |
title_full | Ensuring Data Consistency Over CMS Distributed Computing System |
title_fullStr | Ensuring Data Consistency Over CMS Distributed Computing System |
title_full_unstemmed | Ensuring Data Consistency Over CMS Distributed Computing System |
title_short | Ensuring Data Consistency Over CMS Distributed Computing System |
title_sort | ensuring data consistency over cms distributed computing system |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/1196115 |
work_keys_str_mv | AT rossmanpaul ensuringdataconsistencyovercmsdistributedcomputingsystem |