Cargando…
The DIRAC interware: current, upcoming and planned capabilities and technologies
Efficient access to distributed computing and storage resources is mandatory for the success of current and future High Energy and Nuclear Physics Experiments. DIRAC is an interware to build and operate distributed computing systems. It provides a development framework and a rich set of services for...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024503035 http://cds.cern.ch/record/2758814 |
_version_ | 1780970193835524096 |
---|---|
author | Stagni, Federico Tsaregorodtsev, Andrei Sailer, André Haen, Christophe |
author_facet | Stagni, Federico Tsaregorodtsev, Andrei Sailer, André Haen, Christophe |
author_sort | Stagni, Federico |
collection | CERN |
description | Efficient access to distributed computing and storage resources is mandatory for the success of current and future High Energy and Nuclear Physics Experiments. DIRAC is an interware to build and operate distributed computing systems. It provides a development framework and a rich set of services for the Workload, Data and Production Management tasks of large scientific communities. A single DIRAC installation provides a complete solution for the distributed computing of one, or more than one collaboration. The DIRAC Workload Management System (WMS) provides a transparent, uniform interface for managing computing resources. The DIRAC Data Management System (DMS) offers all the necessary tools to ensure data handling operations: it supports transparent access to storage resources based on multiple technologies, and is easily expandable. Distributed Data management can be performed, also using third party services, and operations are resilient with respect to failures. DIRAC is highly customizable and can be easily extended. For these reasons, a vast and heterogeneous set of scientific collaborations have adopted DIRAC as the base for their computing models. Users from different experiments can interact with the system in different ways, depending on their specific tasks, expertise level and previous experience using command line tools, python APIs or Web Portals. The requirements of the diverse DIRAC user communities and hosting infrastructures triggered multiple developments to improve the system usability: examples include the adoption of industry standard authorization and authentication infrastructure solutions, the management of diverse computing resources (cloud, HPC, GPGPU, etc.), the handling of high-intensity work and data flows, but also advanced monitoring and accounting using no-SQL based solutions and message queues. This contribution will highlight DIRAC’s current, upcoming and planned capabilities and technologies. |
id | oai-inspirehep.net-1831527 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | oai-inspirehep.net-18315272021-03-25T22:33:56Zdoi:10.1051/epjconf/202024503035http://cds.cern.ch/record/2758814engStagni, FedericoTsaregorodtsev, AndreiSailer, AndréHaen, ChristopheThe DIRAC interware: current, upcoming and planned capabilities and technologiesComputing and ComputersEfficient access to distributed computing and storage resources is mandatory for the success of current and future High Energy and Nuclear Physics Experiments. DIRAC is an interware to build and operate distributed computing systems. It provides a development framework and a rich set of services for the Workload, Data and Production Management tasks of large scientific communities. A single DIRAC installation provides a complete solution for the distributed computing of one, or more than one collaboration. The DIRAC Workload Management System (WMS) provides a transparent, uniform interface for managing computing resources. The DIRAC Data Management System (DMS) offers all the necessary tools to ensure data handling operations: it supports transparent access to storage resources based on multiple technologies, and is easily expandable. Distributed Data management can be performed, also using third party services, and operations are resilient with respect to failures. DIRAC is highly customizable and can be easily extended. For these reasons, a vast and heterogeneous set of scientific collaborations have adopted DIRAC as the base for their computing models. Users from different experiments can interact with the system in different ways, depending on their specific tasks, expertise level and previous experience using command line tools, python APIs or Web Portals. The requirements of the diverse DIRAC user communities and hosting infrastructures triggered multiple developments to improve the system usability: examples include the adoption of industry standard authorization and authentication infrastructure solutions, the management of diverse computing resources (cloud, HPC, GPGPU, etc.), the handling of high-intensity work and data flows, but also advanced monitoring and accounting using no-SQL based solutions and message queues. This contribution will highlight DIRAC’s current, upcoming and planned capabilities and technologies.oai:inspirehep.net:18315272020 |
spellingShingle | Computing and Computers Stagni, Federico Tsaregorodtsev, Andrei Sailer, André Haen, Christophe The DIRAC interware: current, upcoming and planned capabilities and technologies |
title | The DIRAC interware: current, upcoming and planned capabilities and technologies |
title_full | The DIRAC interware: current, upcoming and planned capabilities and technologies |
title_fullStr | The DIRAC interware: current, upcoming and planned capabilities and technologies |
title_full_unstemmed | The DIRAC interware: current, upcoming and planned capabilities and technologies |
title_short | The DIRAC interware: current, upcoming and planned capabilities and technologies |
title_sort | dirac interware: current, upcoming and planned capabilities and technologies |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202024503035 http://cds.cern.ch/record/2758814 |
work_keys_str_mv | AT stagnifederico thediracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies AT tsaregorodtsevandrei thediracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies AT sailerandre thediracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies AT haenchristophe thediracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies AT stagnifederico diracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies AT tsaregorodtsevandrei diracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies AT sailerandre diracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies AT haenchristophe diracinterwarecurrentupcomingandplannedcapabilitiesandtechnologies |