Cargando…

Data storage accounting and verification in LHC experiments

All major experiments at Large Hadron Collider (LHC) need to measure real storage usage at the Grid sites. This information is equally important for the resource management, planning, and operations. To verify consistency of the central catalogs, experiments are asking sites to provide full list...

Descripción completa

Detalles Bibliográficos
Autor principal: Ratnikova ,Natalia
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1457875
_version_ 1780925142878126080
author Ratnikova ,Natalia
author_facet Ratnikova ,Natalia
author_sort Ratnikova ,Natalia
collection CERN
description All major experiments at Large Hadron Collider (LHC) need to measure real storage usage at the Grid sites. This information is equally important for the resource management, planning, and operations. To verify consistency of the central catalogs, experiments are asking sites to provide full list of files they have on storage, including size, checksum, and other file attributes. Such storage dumps provided at regular intervals give a realistic view of the storage resource usage by the experiments. Regular monitoring of the space usage and data verification serve as additional internal checks of the system integrity and performance. Both the importance and the complexity of these tasks increase with the constant growth of the total data volumes during the active data taking period at the LHC. Developed common solutions help to reduce the maintenance costs both at the large Tier-1 facilities supporting multiple virtual organizations, and at the small sites that often lack manpower. We discuss requirements and solutions to the common tasks of data storage accounting and verification, and present experiment-specific strategies and implementations used within the LHC experiments according to their computing models.
id cern-1457875
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14578752019-09-30T06:29:59Zhttp://cds.cern.ch/record/1457875engRatnikova ,NataliaData storage accounting and verification in LHC experimentsDetectors and Experimental TechniquesAll major experiments at Large Hadron Collider (LHC) need to measure real storage usage at the Grid sites. This information is equally important for the resource management, planning, and operations. To verify consistency of the central catalogs, experiments are asking sites to provide full list of files they have on storage, including size, checksum, and other file attributes. Such storage dumps provided at regular intervals give a realistic view of the storage resource usage by the experiments. Regular monitoring of the space usage and data verification serve as additional internal checks of the system integrity and performance. Both the importance and the complexity of these tasks increase with the constant growth of the total data volumes during the active data taking period at the LHC. Developed common solutions help to reduce the maintenance costs both at the large Tier-1 facilities supporting multiple virtual organizations, and at the small sites that often lack manpower. We discuss requirements and solutions to the common tasks of data storage accounting and verification, and present experiment-specific strategies and implementations used within the LHC experiments according to their computing models.CMS-CR-2012-155oai:cds.cern.ch:14578752012-06-19
spellingShingle Detectors and Experimental Techniques
Ratnikova ,Natalia
Data storage accounting and verification in LHC experiments
title Data storage accounting and verification in LHC experiments
title_full Data storage accounting and verification in LHC experiments
title_fullStr Data storage accounting and verification in LHC experiments
title_full_unstemmed Data storage accounting and verification in LHC experiments
title_short Data storage accounting and verification in LHC experiments
title_sort data storage accounting and verification in lhc experiments
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1457875
work_keys_str_mv AT ratnikovanatalia datastorageaccountingandverificationinlhcexperiments