Cargando…

CERN Tape Archive: production status, migration from CASTOR and new features

During 2019 and 2020, the CERN tape archive (CTA) will receive new data from LHC experiments and import existing data from CASTOR, which will be phased out for LHC experiments before Run 3.This contribution will present the statuses of CTA as a service and of its integration with EOS and FTS and the...

Descripción completa

Detalles Bibliográficos
Autores principales: Cano, Eric, Bahyl, Vladimír, Caffy, Cédric, Cancio, Germán, Davis, Michael, Kotlyar, Viktor, Leduc, Julien, Lin, Tao, Murray, Steven
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024504013
http://cds.cern.ch/record/2799964
_version_ 1780972602997604352
author Cano, Eric
Bahyl, Vladimír
Caffy, Cédric
Cancio, Germán
Davis, Michael
Kotlyar, Viktor
Leduc, Julien
Lin, Tao
Murray, Steven
author_facet Cano, Eric
Bahyl, Vladimír
Caffy, Cédric
Cancio, Germán
Davis, Michael
Kotlyar, Viktor
Leduc, Julien
Lin, Tao
Murray, Steven
author_sort Cano, Eric
collection CERN
description During 2019 and 2020, the CERN tape archive (CTA) will receive new data from LHC experiments and import existing data from CASTOR, which will be phased out for LHC experiments before Run 3.This contribution will present the statuses of CTA as a service and of its integration with EOS and FTS and the data flow chains of LHC experiments.The latest enhancements and additions to the software as well as the development outlook will be presented. With the development of the repack function, a necessary behind-the-scenes feature, CTA can now take over custodial data and handle media migration, compaction and failures. Further metadata handling optimisations allowed doubling the maximum file rate performance to 200Hz per queue.New retrieve scheduling options are being developed at the request of experiments, with optional FIFO behaviour to ensure better control of the timing for datasets retrieve, and fair share support for competing activities within the same VO.Support for multiple backend databases (Oracle, PostgreSQL, MySQL) have been developed at CERN and contributed by external institutes.This contribution will also report on the challenges of and solutions for migrating data from the decades old CASTOR to CTA. The practical example of the preparation for the migration of ATLAS data will be presented.
id cern-2799964
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling cern-27999642022-01-20T21:41:21Zdoi:10.1051/epjconf/202024504013http://cds.cern.ch/record/2799964engCano, EricBahyl, VladimírCaffy, CédricCancio, GermánDavis, MichaelKotlyar, ViktorLeduc, JulienLin, TaoMurray, StevenCERN Tape Archive: production status, migration from CASTOR and new featuresComputing and ComputersDuring 2019 and 2020, the CERN tape archive (CTA) will receive new data from LHC experiments and import existing data from CASTOR, which will be phased out for LHC experiments before Run 3.This contribution will present the statuses of CTA as a service and of its integration with EOS and FTS and the data flow chains of LHC experiments.The latest enhancements and additions to the software as well as the development outlook will be presented. With the development of the repack function, a necessary behind-the-scenes feature, CTA can now take over custodial data and handle media migration, compaction and failures. Further metadata handling optimisations allowed doubling the maximum file rate performance to 200Hz per queue.New retrieve scheduling options are being developed at the request of experiments, with optional FIFO behaviour to ensure better control of the timing for datasets retrieve, and fair share support for competing activities within the same VO.Support for multiple backend databases (Oracle, PostgreSQL, MySQL) have been developed at CERN and contributed by external institutes.This contribution will also report on the challenges of and solutions for migrating data from the decades old CASTOR to CTA. The practical example of the preparation for the migration of ATLAS data will be presented.oai:cds.cern.ch:27999642020
spellingShingle Computing and Computers
Cano, Eric
Bahyl, Vladimír
Caffy, Cédric
Cancio, Germán
Davis, Michael
Kotlyar, Viktor
Leduc, Julien
Lin, Tao
Murray, Steven
CERN Tape Archive: production status, migration from CASTOR and new features
title CERN Tape Archive: production status, migration from CASTOR and new features
title_full CERN Tape Archive: production status, migration from CASTOR and new features
title_fullStr CERN Tape Archive: production status, migration from CASTOR and new features
title_full_unstemmed CERN Tape Archive: production status, migration from CASTOR and new features
title_short CERN Tape Archive: production status, migration from CASTOR and new features
title_sort cern tape archive: production status, migration from castor and new features
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024504013
http://cds.cern.ch/record/2799964
work_keys_str_mv AT canoeric cerntapearchiveproductionstatusmigrationfromcastorandnewfeatures
AT bahylvladimir cerntapearchiveproductionstatusmigrationfromcastorandnewfeatures
AT caffycedric cerntapearchiveproductionstatusmigrationfromcastorandnewfeatures
AT canciogerman cerntapearchiveproductionstatusmigrationfromcastorandnewfeatures
AT davismichael cerntapearchiveproductionstatusmigrationfromcastorandnewfeatures
AT kotlyarviktor cerntapearchiveproductionstatusmigrationfromcastorandnewfeatures
AT leducjulien cerntapearchiveproductionstatusmigrationfromcastorandnewfeatures
AT lintao cerntapearchiveproductionstatusmigrationfromcastorandnewfeatures
AT murraysteven cerntapearchiveproductionstatusmigrationfromcastorandnewfeatures