Cargando…

An intelligent Data Delivery Service for and beyond the ATLAS Experiment

The intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. iDDS has been designed to intelligently orchestrate workflow and data management systems, decoupling data pre-processing, delivery, an...

Descripción completa

Detalles Bibliográficos
Autores principales: Guan, Wen, Maeno, Tadashi, Bockelman, Brian Paul, Wenaus, Torre, Lin, Fa-Hui, Padolski, Siarhei, Zhang, Rui, Alekseev, Aleksandr, Barreiro Megino, Fernando Harald
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2765400
_version_ 1780971146358816768
author Guan, Wen
Maeno, Tadashi
Bockelman, Brian Paul
Wenaus, Torre
Lin, Fa-Hui
Padolski, Siarhei
Zhang, Rui
Alekseev, Aleksandr
Barreiro Megino, Fernando Harald
author_facet Guan, Wen
Maeno, Tadashi
Bockelman, Brian Paul
Wenaus, Torre
Lin, Fa-Hui
Padolski, Siarhei
Zhang, Rui
Alekseev, Aleksandr
Barreiro Megino, Fernando Harald
author_sort Guan, Wen
collection CERN
description The intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. iDDS has been designed to intelligently orchestrate workflow and data management systems, decoupling data pre-processing, delivery, and main processing in various workflows. It is an experiment-agnostic service around a workflow-oriented structure to work with existing and emerging use cases in ATLAS and other experiments. Here we will present the motivation for iDDS, its design schema and architecture, use cases and current status, and plans for the future.
id cern-2765400
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27654002022-08-23T08:28:32Zhttp://cds.cern.ch/record/2765400engGuan, WenMaeno, TadashiBockelman, Brian PaulWenaus, TorreLin, Fa-HuiPadolski, SiarheiZhang, RuiAlekseev, AleksandrBarreiro Megino, Fernando HaraldAn intelligent Data Delivery Service for and beyond the ATLAS ExperimentParticle Physics - ExperimentThe intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. iDDS has been designed to intelligently orchestrate workflow and data management systems, decoupling data pre-processing, delivery, and main processing in various workflows. It is an experiment-agnostic service around a workflow-oriented structure to work with existing and emerging use cases in ATLAS and other experiments. Here we will present the motivation for iDDS, its design schema and architecture, use cases and current status, and plans for the future.ATL-SOFT-SLIDE-2021-120oai:cds.cern.ch:27654002021-04-28
spellingShingle Particle Physics - Experiment
Guan, Wen
Maeno, Tadashi
Bockelman, Brian Paul
Wenaus, Torre
Lin, Fa-Hui
Padolski, Siarhei
Zhang, Rui
Alekseev, Aleksandr
Barreiro Megino, Fernando Harald
An intelligent Data Delivery Service for and beyond the ATLAS Experiment
title An intelligent Data Delivery Service for and beyond the ATLAS Experiment
title_full An intelligent Data Delivery Service for and beyond the ATLAS Experiment
title_fullStr An intelligent Data Delivery Service for and beyond the ATLAS Experiment
title_full_unstemmed An intelligent Data Delivery Service for and beyond the ATLAS Experiment
title_short An intelligent Data Delivery Service for and beyond the ATLAS Experiment
title_sort intelligent data delivery service for and beyond the atlas experiment
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2765400
work_keys_str_mv AT guanwen anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT maenotadashi anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT bockelmanbrianpaul anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT wenaustorre anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT linfahui anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT padolskisiarhei anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT zhangrui anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT alekseevaleksandr anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT barreiromeginofernandoharald anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT guanwen intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT maenotadashi intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT bockelmanbrianpaul intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT wenaustorre intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT linfahui intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT padolskisiarhei intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT zhangrui intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT alekseevaleksandr intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT barreiromeginofernandoharald intelligentdatadeliveryserviceforandbeyondtheatlasexperiment