Cargando…

CTA best practices for data taking workflows

<!--HTML-->There is significant diversity in the Data Acquisition (DAQ) systems of the non-LHC experiments supported at CERN. Each system can potentially have its own data taking software and helper scripts, and each can use their preferred data transfer commands and apply different checks and...

Descripción completa

Detalles Bibliográficos
Autor principal: Yurchenko, Volodymyr
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2753712
_version_ 1780969367873257472
author Yurchenko, Volodymyr
author_facet Yurchenko, Volodymyr
author_sort Yurchenko, Volodymyr
collection CERN
description <!--HTML-->There is significant diversity in the Data Acquisition (DAQ) systems of the non-LHC experiments supported at CERN. Each system can potentially have its own data taking software and helper scripts, and each can use their preferred data transfer commands and apply different checks and retry policies. The task of the CERN Tape Archive (CTA) team is to provide support for all of these different use cases and to define the best practices for integrating with an EOSCTA instance. In this talk we will present an overview of typical DAQ workflows and discuss which protocols, commands and APIs we recommended to use with EOSCTA. We will provide examples of submitting archive and retrieve requests using FTS and XRootD tools. We will explain how to monitor the status of a file on tape. We will explain the best way to ensure a file is safely stored on tape. We will also give an overview of the CTA authentication policies.
id cern-2753712
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27537122022-11-02T22:19:19Zhttp://cds.cern.ch/record/2753712engYurchenko, VolodymyrCTA best practices for data taking workflowsEOS workshopHEP Computing<!--HTML-->There is significant diversity in the Data Acquisition (DAQ) systems of the non-LHC experiments supported at CERN. Each system can potentially have its own data taking software and helper scripts, and each can use their preferred data transfer commands and apply different checks and retry policies. The task of the CERN Tape Archive (CTA) team is to provide support for all of these different use cases and to define the best practices for integrating with an EOSCTA instance. In this talk we will present an overview of typical DAQ workflows and discuss which protocols, commands and APIs we recommended to use with EOSCTA. We will provide examples of submitting archive and retrieve requests using FTS and XRootD tools. We will explain how to monitor the status of a file on tape. We will explain the best way to ensure a file is safely stored on tape. We will also give an overview of the CTA authentication policies.oai:cds.cern.ch:27537122021
spellingShingle HEP Computing
Yurchenko, Volodymyr
CTA best practices for data taking workflows
title CTA best practices for data taking workflows
title_full CTA best practices for data taking workflows
title_fullStr CTA best practices for data taking workflows
title_full_unstemmed CTA best practices for data taking workflows
title_short CTA best practices for data taking workflows
title_sort cta best practices for data taking workflows
topic HEP Computing
url http://cds.cern.ch/record/2753712
work_keys_str_mv AT yurchenkovolodymyr ctabestpracticesfordatatakingworkflows
AT yurchenkovolodymyr eosworkshop