Cargando…

Experiences and challenges running CERN's high capacity tape archive

CERN's tape-based archive system has collected over 70 Petabytes of data during the first run of the LHC. The Long Shutdown is being used for migrating the complete 100 Petabytes data archive to higher-density tape media. During LHC Run 2, the archive will have to cope with yearly growth rates...

Descripción completa

Detalles Bibliográficos
Autores principales: Cancio, Germ, Bahyl, Vladim, Kruse, Daniele Francesco, Leduc, Julien, Cano, Eric, Murray, Steven
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/664/4/042006
http://cds.cern.ch/record/2134554
_version_ 1780949904059793408
author Cancio, Germ
Bahyl, Vladim
Kruse, Daniele Francesco
Leduc, Julien
Cano, Eric
Murray, Steven
author_facet Cancio, Germ
Bahyl, Vladim
Kruse, Daniele Francesco
Leduc, Julien
Cano, Eric
Murray, Steven
author_sort Cancio, Germ
collection CERN
description CERN's tape-based archive system has collected over 70 Petabytes of data during the first run of the LHC. The Long Shutdown is being used for migrating the complete 100 Petabytes data archive to higher-density tape media. During LHC Run 2, the archive will have to cope with yearly growth rates of up to 40-50 Petabytes. In this contribution, we describe the scalable setup for coping with the storage and long-term archival of such massive data amounts. We also review the challenges resulting and mechanisms devised for measuring and enhancing availability and reliability, as well as ensuring the long-term integrity and bit-level preservation of the complete data repository. The procedures and tools for the proactive and efficient operation of the tape infrastructure are described, including the features developed for automated problem detection, identification and notification. Finally, we present an outlook in terms of future capacity requirements growth and how it matches the expected tape technology evolution.
id oai-inspirehep.net-1413838
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling oai-inspirehep.net-14138382022-08-10T13:00:52Zdoi:10.1088/1742-6596/664/4/042006http://cds.cern.ch/record/2134554engCancio, GermBahyl, VladimKruse, Daniele FrancescoLeduc, JulienCano, EricMurray, StevenExperiences and challenges running CERN's high capacity tape archiveComputing and ComputersCERN's tape-based archive system has collected over 70 Petabytes of data during the first run of the LHC. The Long Shutdown is being used for migrating the complete 100 Petabytes data archive to higher-density tape media. During LHC Run 2, the archive will have to cope with yearly growth rates of up to 40-50 Petabytes. In this contribution, we describe the scalable setup for coping with the storage and long-term archival of such massive data amounts. We also review the challenges resulting and mechanisms devised for measuring and enhancing availability and reliability, as well as ensuring the long-term integrity and bit-level preservation of the complete data repository. The procedures and tools for the proactive and efficient operation of the tape infrastructure are described, including the features developed for automated problem detection, identification and notification. Finally, we present an outlook in terms of future capacity requirements growth and how it matches the expected tape technology evolution.oai:inspirehep.net:14138382015
spellingShingle Computing and Computers
Cancio, Germ
Bahyl, Vladim
Kruse, Daniele Francesco
Leduc, Julien
Cano, Eric
Murray, Steven
Experiences and challenges running CERN's high capacity tape archive
title Experiences and challenges running CERN's high capacity tape archive
title_full Experiences and challenges running CERN's high capacity tape archive
title_fullStr Experiences and challenges running CERN's high capacity tape archive
title_full_unstemmed Experiences and challenges running CERN's high capacity tape archive
title_short Experiences and challenges running CERN's high capacity tape archive
title_sort experiences and challenges running cern's high capacity tape archive
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/664/4/042006
http://cds.cern.ch/record/2134554
work_keys_str_mv AT canciogerm experiencesandchallengesrunningcernshighcapacitytapearchive
AT bahylvladim experiencesandchallengesrunningcernshighcapacitytapearchive
AT krusedanielefrancesco experiencesandchallengesrunningcernshighcapacitytapearchive
AT leducjulien experiencesandchallengesrunningcernshighcapacitytapearchive
AT canoeric experiencesandchallengesrunningcernshighcapacitytapearchive
AT murraysteven experiencesandchallengesrunningcernshighcapacitytapearchive