Cargando…
Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework
The new JAliEn (Java ALICE Environment) middleware is a Grid framework designed to satisfy the needs of the ALICE experiment for the LHC Run 3, such as providing a high-performance and high-scalability service to cope with the increased volumes of collected data. This new framework also introduces a...
Autores principales: | , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024507052 http://cds.cern.ch/record/2753509 |
_version_ | 1780969441732853760 |
---|---|
author | Storetvedt, Maxim Betev, Latchezar Helstrup, Håvard Hetland, Kristin Fanebust Kileng, Bjarte |
author_facet | Storetvedt, Maxim Betev, Latchezar Helstrup, Håvard Hetland, Kristin Fanebust Kileng, Bjarte |
author_sort | Storetvedt, Maxim |
collection | CERN |
description | The new JAliEn (Java ALICE Environment) middleware is a Grid framework designed to satisfy the needs of the ALICE experiment for the LHC Run 3, such as providing a high-performance and high-scalability service to cope with the increased volumes of collected data. This new framework also introduces a split, two-layered job pilot, creating a new approach to how jobs are handled and executed within the Grid. Each layer runs on a separate JVM, with a separate authentication token, allowing for a finer control of permissions and improved isolation of the payload. Having these separate layers also allows for the execution of job payloads within containers. This allows for the further strengthening of isolation and creates a cohesive environment across computing sites, while avoiding the resource overhead associated with traditional virtualisation.This contribution presents the architecture of the new split job pilot found in JAliEn, and the methods used to achieve the execution of Grid jobs while maintaining reliable communication between layers. Specifically, how this is achieved despite the possibility of a layer being run in a separate container, while retaining isolation and mitigating possible security risks. Furthermore, we discuss how the implementation remains agnostic to the choice of container platform, allowing it to run within popular platforms such as Singularity and Docker. |
id | oai-inspirehep.net-1832107 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | oai-inspirehep.net-18321072021-03-04T20:31:41Zdoi:10.1051/epjconf/202024507052http://cds.cern.ch/record/2753509engStoretvedt, MaximBetev, LatchezarHelstrup, HåvardHetland, Kristin FanebustKileng, BjarteRunning ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid frameworkComputing and ComputersThe new JAliEn (Java ALICE Environment) middleware is a Grid framework designed to satisfy the needs of the ALICE experiment for the LHC Run 3, such as providing a high-performance and high-scalability service to cope with the increased volumes of collected data. This new framework also introduces a split, two-layered job pilot, creating a new approach to how jobs are handled and executed within the Grid. Each layer runs on a separate JVM, with a separate authentication token, allowing for a finer control of permissions and improved isolation of the payload. Having these separate layers also allows for the execution of job payloads within containers. This allows for the further strengthening of isolation and creates a cohesive environment across computing sites, while avoiding the resource overhead associated with traditional virtualisation.This contribution presents the architecture of the new split job pilot found in JAliEn, and the methods used to achieve the execution of Grid jobs while maintaining reliable communication between layers. Specifically, how this is achieved despite the possibility of a layer being run in a separate container, while retaining isolation and mitigating possible security risks. Furthermore, we discuss how the implementation remains agnostic to the choice of container platform, allowing it to run within popular platforms such as Singularity and Docker.oai:inspirehep.net:18321072020 |
spellingShingle | Computing and Computers Storetvedt, Maxim Betev, Latchezar Helstrup, Håvard Hetland, Kristin Fanebust Kileng, Bjarte Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework |
title | Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework |
title_full | Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework |
title_fullStr | Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework |
title_full_unstemmed | Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework |
title_short | Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework |
title_sort | running alice grid jobs in containers: a new approach to job execution for the next generation alice grid framework |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202024507052 http://cds.cern.ch/record/2753509 |
work_keys_str_mv | AT storetvedtmaxim runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework AT betevlatchezar runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework AT helstruphavard runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework AT hetlandkristinfanebust runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework AT kilengbjarte runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework |