Cargando…

DIRAC universal pilots

In the last few years, new types of computing models, such as IAAS (Infrastructure as a Service) and IAAC (Infrastructure as a Client), gained popularity. New resources may come as part of pledged resources, while others are in the form of opportunistic ones. Most but not all of these new infrastruc...

Descripción completa

Detalles Bibliográficos
Autores principales: Stagni, F, McNab, A, Luzzi, C, Krzemien, W
Lenguaje:eng
Publicado: 2017
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/898/9/092024
http://cds.cern.ch/record/2296666
_version_ 1780956908378652672
author Stagni, F
McNab, A
Luzzi, C
Krzemien, W
author_facet Stagni, F
McNab, A
Luzzi, C
Krzemien, W
author_sort Stagni, F
collection CERN
description In the last few years, new types of computing models, such as IAAS (Infrastructure as a Service) and IAAC (Infrastructure as a Client), gained popularity. New resources may come as part of pledged resources, while others are in the form of opportunistic ones. Most but not all of these new infrastructures are based on virtualization techniques. In addition, some of them, present opportunities for multi-processor computing slots to the users. Virtual Organizations are therefore facing heterogeneity of the available resources and the use of an Interware software like DIRAC to provide the transparent, uniform interface has become essential. The transparent access to the underlying resources is realized by implementing the pilot model. DIRAC’s newest generation of generic pilots (the so-called Pilots 2.0) are the “pilots for all the skies”, and have been successfully released in production more than a year ago. They use a plugin mechanism that makes them easily adaptable. Pilots 2.0 have been used for fetching and running jobs on every type of resource, being it a Worker Node (WN) behind a CREAM/ARC/HTCondor/DIRAC Computing element, a Virtual Machine running on IaaC infrastructures like Vac or BOINC, on IaaS cloud resources managed by Vcycle, the LHCb High Level Trigger farm nodes, and any type of opportunistic computing resource. Make a machine a “Pilot Machine”, and all diversities between them will disappear. This contribution describes how pilots are made suitable for different resources, and the recent steps taken towards a fully unified framework, including monitoring. Also, the cases of multi-processor computing slots either on real or virtual machines, with the whole node or a partition of it, is discussed.
id oai-inspirehep.net-1638619
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2017
record_format invenio
spelling oai-inspirehep.net-16386192021-06-23T12:13:22Zdoi:10.1088/1742-6596/898/9/092024http://cds.cern.ch/record/2296666engStagni, FMcNab, ALuzzi, CKrzemien, WDIRAC universal pilotsComputing and ComputersIn the last few years, new types of computing models, such as IAAS (Infrastructure as a Service) and IAAC (Infrastructure as a Client), gained popularity. New resources may come as part of pledged resources, while others are in the form of opportunistic ones. Most but not all of these new infrastructures are based on virtualization techniques. In addition, some of them, present opportunities for multi-processor computing slots to the users. Virtual Organizations are therefore facing heterogeneity of the available resources and the use of an Interware software like DIRAC to provide the transparent, uniform interface has become essential. The transparent access to the underlying resources is realized by implementing the pilot model. DIRAC’s newest generation of generic pilots (the so-called Pilots 2.0) are the “pilots for all the skies”, and have been successfully released in production more than a year ago. They use a plugin mechanism that makes them easily adaptable. Pilots 2.0 have been used for fetching and running jobs on every type of resource, being it a Worker Node (WN) behind a CREAM/ARC/HTCondor/DIRAC Computing element, a Virtual Machine running on IaaC infrastructures like Vac or BOINC, on IaaS cloud resources managed by Vcycle, the LHCb High Level Trigger farm nodes, and any type of opportunistic computing resource. Make a machine a “Pilot Machine”, and all diversities between them will disappear. This contribution describes how pilots are made suitable for different resources, and the recent steps taken towards a fully unified framework, including monitoring. Also, the cases of multi-processor computing slots either on real or virtual machines, with the whole node or a partition of it, is discussed.oai:inspirehep.net:16386192017
spellingShingle Computing and Computers
Stagni, F
McNab, A
Luzzi, C
Krzemien, W
DIRAC universal pilots
title DIRAC universal pilots
title_full DIRAC universal pilots
title_fullStr DIRAC universal pilots
title_full_unstemmed DIRAC universal pilots
title_short DIRAC universal pilots
title_sort dirac universal pilots
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/898/9/092024
http://cds.cern.ch/record/2296666
work_keys_str_mv AT stagnif diracuniversalpilots
AT mcnaba diracuniversalpilots
AT luzzic diracuniversalpilots
AT krzemienw diracuniversalpilots