An overview of a large-scale data migration

We present an overview of the migration of the data collected by the COMPASS experiment at CERN. In less than three months, almost 300 TB will be migrated at a sustained data rate approaching 100 MB/s, using a distributed system with multiple nodes and data servers. This project, which is being carr...

Descripción completa

Detalles Bibliográficos
Autores principales: Lubeck, M, Geppert, D, Nienartowicz, K
Lenguaje:eng
Publicado: 2003
Materias:
Acceso en línea:http://cds.cern.ch/record/643235
_version_ 1780900765866393600
author Lubeck, M
Geppert, D
Nienartowicz, K
author_facet Lubeck, M
Geppert, D
Nienartowicz, K
author_sort Lubeck, M
collection CERN
description We present an overview of the migration of the data collected by the COMPASS experiment at CERN. In less than three months, almost 300 TB will be migrated at a sustained data rate approaching 100 MB/s, using a distributed system with multiple nodes and data servers. This project, which is being carried out by the Database Group of CERN's IT Division and is expected to be completed by early 2003, involves both a physical media migration, from StorageTek 9940A to StorageTek 9940B tapes, and a data format conversion, from an object database management system to a hybrid persistency mechanism based on flat files referenced in a relational database management system. (11 refs).
id cern-643235
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2003
record_format invenio
spelling cern-6432352019-09-30T06:29:59Zhttp://cds.cern.ch/record/643235engLubeck, MGeppert, DNienartowicz, KAn overview of a large-scale data migrationDetectors and Experimental TechniquesWe present an overview of the migration of the data collected by the COMPASS experiment at CERN. In less than three months, almost 300 TB will be migrated at a sustained data rate approaching 100 MB/s, using a distributed system with multiple nodes and data servers. This project, which is being carried out by the Database Group of CERN's IT Division and is expected to be completed by early 2003, involves both a physical media migration, from StorageTek 9940A to StorageTek 9940B tapes, and a data format conversion, from an object database management system to a hybrid persistency mechanism based on flat files referenced in a relational database management system. (11 refs).oai:cds.cern.ch:6432352003
spellingShingle Detectors and Experimental Techniques
Lubeck, M
Geppert, D
Nienartowicz, K
An overview of a large-scale data migration
title An overview of a large-scale data migration
title_full An overview of a large-scale data migration
title_fullStr An overview of a large-scale data migration
title_full_unstemmed An overview of a large-scale data migration
title_short An overview of a large-scale data migration
title_sort overview of a large-scale data migration
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/643235
work_keys_str_mv AT lubeckm anoverviewofalargescaledatamigration
AT geppertd anoverviewofalargescaledatamigration
AT nienartowiczk anoverviewofalargescaledatamigration
AT lubeckm overviewofalargescaledatamigration
AT geppertd overviewofalargescaledatamigration
AT nienartowiczk overviewofalargescaledatamigration