An intelligent Data Delivery Service for and beyond the ATLAS experiment

Mostrar otras versiones (3)

The intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. iDDS has been designed to intelligently orchestrate workflow and data management systems, decoupling data pre-processing, delivery, an...

Descripción completa

Detalles Bibliográficos
Autores principales: Guan, Wen, Maeno, Tadashi, Bockelman, Brian Paul, Wenaus, Torre, Lin, Fa-Hui, Padolski, Siarhei, Zhang, Rui, Alekseev, Aleksandr
Lenguaje:eng
Publicado: 2021
Materias:
Particle Physics - Experiment
Computing and Computers
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202125102007
http://cds.cern.ch/record/2774104
_version_ 1780971545130172416
author Guan, Wen
Maeno, Tadashi
Bockelman, Brian Paul
Wenaus, Torre
Lin, Fa-Hui
Padolski, Siarhei
Zhang, Rui
Alekseev, Aleksandr
author_facet Guan, Wen
Maeno, Tadashi
Bockelman, Brian Paul
Wenaus, Torre
Lin, Fa-Hui
Padolski, Siarhei
Zhang, Rui
Alekseev, Aleksandr
author_sort Guan, Wen
collection CERN
description The intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. iDDS has been designed to intelligently orchestrate workflow and data management systems, decoupling data pre-processing, delivery, and main processing in various workflows. It is an experiment-agnostic service around a workflow- oriented structure to work with existing and emerging use cases in ATLAS and other experiments. Here we will present the motivation for iDDS, its design schema and architecture, use cases and current status, and plans for the future.
id cern-2774104
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27741042023-01-31T10:55:43Zdoi:10.1051/epjconf/202125102007http://cds.cern.ch/record/2774104engGuan, WenMaeno, TadashiBockelman, Brian PaulWenaus, TorreLin, Fa-HuiPadolski, SiarheiZhang, RuiAlekseev, AleksandrAn intelligent Data Delivery Service for and beyond the ATLAS experimentParticle Physics - ExperimentComputing and ComputersThe intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. iDDS has been designed to intelligently orchestrate workflow and data management systems, decoupling data pre-processing, delivery, and main processing in various workflows. It is an experiment-agnostic service around a workflow- oriented structure to work with existing and emerging use cases in ATLAS and other experiments. Here we will present the motivation for iDDS, its design schema and architecture, use cases and current status, and plans for the future.The intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. iDDS has been designed to intelligently orchestrate workflow and data management systems, decoupling data pre-processing, delivery, and main processing in various workflows. It is an experiment-agnostic service around a workflow-oriented structure to work with existing and emerging use cases in ATLAS and other experiments. Here we will present the motivation for iDDS, its design schema and architecture, use cases and current status, and plans for the future.The intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. iDDS has been designed to intelligently orchestrate workflow and data management systems, decoupling data pre-processing, delivery, and main processing in various workflows. It is an experiment-agnostic service around a workflow-oriented structure to work with existing and emerging use cases in ATLAS and other experiments. Here we will present the motivation for iDDS, its design schema and architecture, use cases and current status, and plans for the future.arXiv:2103.00523ATL-SOFT-PROC-2021-002ATL-SOFT-PROC-2021-018oai:cds.cern.ch:27741042021-02-22
spellingShingle Particle Physics - Experiment
Computing and Computers
Guan, Wen
Maeno, Tadashi
Bockelman, Brian Paul
Wenaus, Torre
Lin, Fa-Hui
Padolski, Siarhei
Zhang, Rui
Alekseev, Aleksandr
An intelligent Data Delivery Service for and beyond the ATLAS experiment
title An intelligent Data Delivery Service for and beyond the ATLAS experiment
title_full An intelligent Data Delivery Service for and beyond the ATLAS experiment
title_fullStr An intelligent Data Delivery Service for and beyond the ATLAS experiment
title_full_unstemmed An intelligent Data Delivery Service for and beyond the ATLAS experiment
title_short An intelligent Data Delivery Service for and beyond the ATLAS experiment
title_sort intelligent data delivery service for and beyond the atlas experiment
topic Particle Physics - Experiment
Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202125102007
http://cds.cern.ch/record/2774104
work_keys_str_mv AT guanwen anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT maenotadashi anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT bockelmanbrianpaul anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT wenaustorre anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT linfahui anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT padolskisiarhei anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT zhangrui anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT alekseevaleksandr anintelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT guanwen intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT maenotadashi intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT bockelmanbrianpaul intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT wenaustorre intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT linfahui intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT padolskisiarhei intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT zhangrui intelligentdatadeliveryserviceforandbeyondtheatlasexperiment
AT alekseevaleksandr intelligentdatadeliveryserviceforandbeyondtheatlasexperiment

Ejemplares similares