Data Location, Transfer and Bookkeeping in CMS

Within 5 years CMS expects to be managing many tens of petabytes of data at over a hundred sites around the world. This represents more than an order of magnitude increase in data volume over existing HEP experiments. The underlying concepts and architecture of the CMS model for distributed data man...

Descripción completa

Detalles Bibliográficos
Autores principales: Delgado Peris, A, Fanfani, A, Farina, F, Verlato, M, Elmer, P, Tuura, L, Afaq, A, Guo, Y, Kosyakov, S, Lueking, L, Sekhri, V, Dolgert, A, Jones, C, Kuznetsov, V, Riley, D, Rehn, J, Metson, S, Feichtinger, D, Egeland, R, Toteva, Z, Bockelman, B
Lenguaje:eng
Publicado: 2008
Materias:
Detectors and Experimental Techniques
Computing and Computers
Acceso en línea:https://dx.doi.org/10.1016/j.nuclphysbps.2007.11.128
http://cds.cern.ch/record/1097197
_version_ 1780913921111097344
author Delgado Peris, A
Fanfani, A
Farina, F
Verlato, M
Elmer, P
Tuura, L
Afaq, A
Guo, Y
Kosyakov, S
Lueking, L
Sekhri, V
Dolgert, A
Jones, C
Kuznetsov, V
Riley, D
Rehn, J
Metson, S
Feichtinger, D
Egeland, R
Toteva, Z
Bockelman, B
author_facet Delgado Peris, A
Fanfani, A
Farina, F
Verlato, M
Elmer, P
Tuura, L
Afaq, A
Guo, Y
Kosyakov, S
Lueking, L
Sekhri, V
Dolgert, A
Jones, C
Kuznetsov, V
Riley, D
Rehn, J
Metson, S
Feichtinger, D
Egeland, R
Toteva, Z
Bockelman, B
author_sort Delgado Peris, A
collection CERN
description Within 5 years CMS expects to be managing many tens of petabytes of data at over a hundred sites around the world. This represents more than an order of magnitude increase in data volume over existing HEP experiments. The underlying concepts and architecture of the CMS model for distributed data management will be presented. The technical descriptions of the main data management components for data transfer, dataset bookkeeping, data location and file access will be described. In addition we will present the experience in using the system in CMS data challenges and ongoing MC production.
id cern-1097197
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2008
record_format invenio
spelling cern-10971972019-09-30T06:29:59Zdoi:10.1016/j.nuclphysbps.2007.11.128http://cds.cern.ch/record/1097197engDelgado Peris, AFanfani, AFarina, FVerlato, MElmer, PTuura, LAfaq, AGuo, YKosyakov, SLueking, LSekhri, VDolgert, AJones, CKuznetsov, VRiley, DRehn, JMetson, SFeichtinger, DEgeland, RToteva, ZBockelman, BData Location, Transfer and Bookkeeping in CMSDetectors and Experimental TechniquesComputing and ComputersWithin 5 years CMS expects to be managing many tens of petabytes of data at over a hundred sites around the world. This represents more than an order of magnitude increase in data volume over existing HEP experiments. The underlying concepts and architecture of the CMS model for distributed data management will be presented. The technical descriptions of the main data management components for data transfer, dataset bookkeeping, data location and file access will be described. In addition we will present the experience in using the system in CMS data challenges and ongoing MC production.oai:cds.cern.ch:10971972008
spellingShingle Detectors and Experimental Techniques
Computing and Computers
Delgado Peris, A
Fanfani, A
Farina, F
Verlato, M
Elmer, P
Tuura, L
Afaq, A
Guo, Y
Kosyakov, S
Lueking, L
Sekhri, V
Dolgert, A
Jones, C
Kuznetsov, V
Riley, D
Rehn, J
Metson, S
Feichtinger, D
Egeland, R
Toteva, Z
Bockelman, B
Data Location, Transfer and Bookkeeping in CMS
title Data Location, Transfer and Bookkeeping in CMS
title_full Data Location, Transfer and Bookkeeping in CMS
title_fullStr Data Location, Transfer and Bookkeeping in CMS
title_full_unstemmed Data Location, Transfer and Bookkeeping in CMS
title_short Data Location, Transfer and Bookkeeping in CMS
title_sort data location, transfer and bookkeeping in cms
topic Detectors and Experimental Techniques
Computing and Computers
url https://dx.doi.org/10.1016/j.nuclphysbps.2007.11.128
http://cds.cern.ch/record/1097197
work_keys_str_mv AT delgadoperisa datalocationtransferandbookkeepingincms
AT fanfania datalocationtransferandbookkeepingincms
AT farinaf datalocationtransferandbookkeepingincms
AT verlatom datalocationtransferandbookkeepingincms
AT elmerp datalocationtransferandbookkeepingincms
AT tuural datalocationtransferandbookkeepingincms
AT afaqa datalocationtransferandbookkeepingincms
AT guoy datalocationtransferandbookkeepingincms
AT kosyakovs datalocationtransferandbookkeepingincms
AT luekingl datalocationtransferandbookkeepingincms
AT sekhriv datalocationtransferandbookkeepingincms
AT dolgerta datalocationtransferandbookkeepingincms
AT jonesc datalocationtransferandbookkeepingincms
AT kuznetsovv datalocationtransferandbookkeepingincms
AT rileyd datalocationtransferandbookkeepingincms
AT rehnj datalocationtransferandbookkeepingincms
AT metsons datalocationtransferandbookkeepingincms
AT feichtingerd datalocationtransferandbookkeepingincms
AT egelandr datalocationtransferandbookkeepingincms
AT totevaz datalocationtransferandbookkeepingincms
AT bockelmanb datalocationtransferandbookkeepingincms

Ejemplares similares