Cargando…

The DIRAC interware: current, upcoming and planned capabilities and technologies

Efficient access to distributed computing and storage resources is mandatory for the success of current and future High Energy and Nuclear Physics Experiments. DIRAC is an interware to build and operate distributed computing systems. It provides a development framework and a rich set of services for...

Descripción completa

Detalles Bibliográficos
Autores principales: Stagni, Federico, Tsaregorodtsev, Andrei, Sailer, André, Haen, Christophe
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024503035
http://cds.cern.ch/record/2758814
_version_ 1780970193835524096
author Stagni, Federico
Tsaregorodtsev, Andrei
Sailer, André
Haen, Christophe
author_facet Stagni, Federico
Tsaregorodtsev, Andrei
Sailer, André
Haen, Christophe
author_sort Stagni, Federico
collection CERN
description Efficient access to distributed computing and storage resources is mandatory for the success of current and future High Energy and Nuclear Physics Experiments. DIRAC is an interware to build and operate distributed computing systems. It provides a development framework and a rich set of services for the Workload, Data and Production Management tasks of large scientific communities. A single DIRAC installation provides a complete solution for the distributed computing of one, or more than one collaboration. The DIRAC Workload Management System (WMS) provides a transparent, uniform interface for managing computing resources. The DIRAC Data Management System (DMS) offers all the necessary tools to ensure data handling operations: it supports transparent access to storage resources based on multiple technologies, and is easily expandable. Distributed Data management can be performed, also using third party services, and operations are resilient with respect to failures. DIRAC is highly customizable and can be easily extended. For these reasons, a vast and heterogeneous set of scientific collaborations have adopted DIRAC as the base for their computing models. Users from different experiments can interact with the system in different ways, depending on their specific tasks, expertise level and previous experience using command line tools, python APIs or Web Portals. The requirements of the diverse DIRAC user communities and hosting infrastructures triggered multiple developments to improve the system usability: examples include the adoption of industry standard authorization and authentication infrastructure solutions, the management of diverse computing resources (cloud, HPC, GPGPU, etc.), the handling of high-intensity work and data flows, but also advanced monitoring and accounting using no-SQL based solutions and message queues. This contribution will highlight DIRAC’s current, upcoming and planned capabilities and technologies.
id oai-inspirehep.net-1831527
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling oai-inspirehep.net-18315272021-03-25T22:33:56Zdoi:10.1051/epjconf/202024503035http://cds.cern.ch/record/2758814engStagni, FedericoTsaregorodtsev, AndreiSailer, AndréHaen, ChristopheThe DIRAC interware: current, upcoming and planned capabilities and technologiesComputing and ComputersEfficient access to distributed computing and storage resources is mandatory for the success of current and future High Energy and Nuclear Physics Experiments. DIRAC is an interware to build and operate distributed computing systems. It provides a development framework and a rich set of services for the Workload, Data and Production Management tasks of large scientific communities. A single DIRAC installation provides a complete solution for the distributed computing of one, or more than one collaboration. The DIRAC Workload Management System (WMS) provides a transparent, uniform interface for managing computing resources. The DIRAC Data Management System (DMS) offers all the necessary tools to ensure data handling operations: it supports transparent access to storage resources based on multiple technologies, and is easily expandable. Distributed Data management can be performed, also using third party services, and operations are resilient with respect to failures. DIRAC is highly customizable and can be easily extended. For these reasons, a vast and heterogeneous set of scientific collaborations have adopted DIRAC as the base for their computing models. Users from different experiments can interact with the system in different ways, depending on their specific tasks, expertise level and previous experience using command line tools, python APIs or Web Portals. The requirements of the diverse DIRAC user communities and hosting infrastructures triggered multiple developments to improve the system usability: examples include the adoption of industry standard authorization and authentication infrastructure solutions, the management of diverse computing resources (cloud, HPC, GPGPU, etc.), the handling of high-intensity work and data flows, but also advanced monitoring and accounting using no-SQL based solutions and message queues. This contribution will highlight DIRAC’s current, upcoming and planned capabilities and technologies.oai:inspirehep.net:18315272020
spellingShingle Computing and Computers
Stagni, Federico
Tsaregorodtsev, Andrei
Sailer, André
Haen, Christophe
The DIRAC interware: current, upcoming and planned capabilities and technologies
title The DIRAC interware: current, upcoming and planned capabilities and technologies
title_full The DIRAC interware: current, upcoming and planned capabilities and technologies
title_fullStr The DIRAC interware: current, upcoming and planned capabilities and technologies
title_full_unstemmed The DIRAC interware: current, upcoming and planned capabilities and technologies
title_short The DIRAC interware: current, upcoming and planned capabilities and technologies
title_sort dirac interware: current, upcoming and planned capabilities and technologies
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024503035
http://cds.cern.ch/record/2758814
work_keys_str_mv AT stagnifederico thediracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies
AT tsaregorodtsevandrei thediracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies
AT sailerandre thediracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies
AT haenchristophe thediracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies
AT stagnifederico diracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies
AT tsaregorodtsevandrei diracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies
AT sailerandre diracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies
AT haenchristophe diracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies