Cargando…
Experiences and challenges running CERN's high capacity tape archive
CERN's tape-based archive system has collected over 70 Petabytes of data during the first run of the LHC. The Long Shutdown is being used for migrating the complete 100 Petabytes data archive to higher-density tape media. During LHC Run 2, the archive will have to cope with yearly growth rates...
Autores principales: | , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/664/4/042006 http://cds.cern.ch/record/2134554 |
_version_ | 1780949904059793408 |
---|---|
author | Cancio, Germ Bahyl, Vladim Kruse, Daniele Francesco Leduc, Julien Cano, Eric Murray, Steven |
author_facet | Cancio, Germ Bahyl, Vladim Kruse, Daniele Francesco Leduc, Julien Cano, Eric Murray, Steven |
author_sort | Cancio, Germ |
collection | CERN |
description | CERN's tape-based archive system has collected over 70 Petabytes of data during the first run of the LHC. The Long Shutdown is being used for migrating the complete 100 Petabytes data archive to higher-density tape media. During LHC Run 2, the archive will have to cope with yearly growth rates of up to 40-50 Petabytes. In this contribution, we describe the scalable setup for coping with the storage and long-term archival of such massive data amounts. We also review the challenges resulting and mechanisms devised for measuring and enhancing availability and reliability, as well as ensuring the long-term integrity and bit-level preservation of the complete data repository. The procedures and tools for the proactive and efficient operation of the tape infrastructure are described, including the features developed for automated problem detection, identification and notification. Finally, we present an outlook in terms of future capacity requirements growth and how it matches the expected tape technology evolution. |
id | oai-inspirehep.net-1413838 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | oai-inspirehep.net-14138382022-08-10T13:00:52Zdoi:10.1088/1742-6596/664/4/042006http://cds.cern.ch/record/2134554engCancio, GermBahyl, VladimKruse, Daniele FrancescoLeduc, JulienCano, EricMurray, StevenExperiences and challenges running CERN's high capacity tape archiveComputing and ComputersCERN's tape-based archive system has collected over 70 Petabytes of data during the first run of the LHC. The Long Shutdown is being used for migrating the complete 100 Petabytes data archive to higher-density tape media. During LHC Run 2, the archive will have to cope with yearly growth rates of up to 40-50 Petabytes. In this contribution, we describe the scalable setup for coping with the storage and long-term archival of such massive data amounts. We also review the challenges resulting and mechanisms devised for measuring and enhancing availability and reliability, as well as ensuring the long-term integrity and bit-level preservation of the complete data repository. The procedures and tools for the proactive and efficient operation of the tape infrastructure are described, including the features developed for automated problem detection, identification and notification. Finally, we present an outlook in terms of future capacity requirements growth and how it matches the expected tape technology evolution.oai:inspirehep.net:14138382015 |
spellingShingle | Computing and Computers Cancio, Germ Bahyl, Vladim Kruse, Daniele Francesco Leduc, Julien Cano, Eric Murray, Steven Experiences and challenges running CERN's high capacity tape archive |
title | Experiences and challenges running CERN's high capacity tape archive |
title_full | Experiences and challenges running CERN's high capacity tape archive |
title_fullStr | Experiences and challenges running CERN's high capacity tape archive |
title_full_unstemmed | Experiences and challenges running CERN's high capacity tape archive |
title_short | Experiences and challenges running CERN's high capacity tape archive |
title_sort | experiences and challenges running cern's high capacity tape archive |
topic | Computing and Computers |
url | https://dx.doi.org/10.1088/1742-6596/664/4/042006 http://cds.cern.ch/record/2134554 |
work_keys_str_mv | AT canciogerm experiencesandchallengesrunningcernshighcapacitytapearchive AT bahylvladim experiencesandchallengesrunningcernshighcapacitytapearchive AT krusedanielefrancesco experiencesandchallengesrunningcernshighcapacitytapearchive AT leducjulien experiencesandchallengesrunningcernshighcapacitytapearchive AT canoeric experiencesandchallengesrunningcernshighcapacitytapearchive AT murraysteven experiencesandchallengesrunningcernshighcapacitytapearchive |