Cargando…

Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework

The new JAliEn (Java ALICE Environment) middleware is a Grid framework designed to satisfy the needs of the ALICE experiment for the LHC Run 3, such as providing a high-performance and high-scalability service to cope with the increased volumes of collected data. This new framework also introduces a...

Descripción completa

Detalles Bibliográficos
Autores principales: Storetvedt, Maxim, Betev, Latchezar, Helstrup, Håvard, Hetland, Kristin Fanebust, Kileng, Bjarte
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024507052
http://cds.cern.ch/record/2753509
_version_ 1780969441732853760
author Storetvedt, Maxim
Betev, Latchezar
Helstrup, Håvard
Hetland, Kristin Fanebust
Kileng, Bjarte
author_facet Storetvedt, Maxim
Betev, Latchezar
Helstrup, Håvard
Hetland, Kristin Fanebust
Kileng, Bjarte
author_sort Storetvedt, Maxim
collection CERN
description The new JAliEn (Java ALICE Environment) middleware is a Grid framework designed to satisfy the needs of the ALICE experiment for the LHC Run 3, such as providing a high-performance and high-scalability service to cope with the increased volumes of collected data. This new framework also introduces a split, two-layered job pilot, creating a new approach to how jobs are handled and executed within the Grid. Each layer runs on a separate JVM, with a separate authentication token, allowing for a finer control of permissions and improved isolation of the payload. Having these separate layers also allows for the execution of job payloads within containers. This allows for the further strengthening of isolation and creates a cohesive environment across computing sites, while avoiding the resource overhead associated with traditional virtualisation.This contribution presents the architecture of the new split job pilot found in JAliEn, and the methods used to achieve the execution of Grid jobs while maintaining reliable communication between layers. Specifically, how this is achieved despite the possibility of a layer being run in a separate container, while retaining isolation and mitigating possible security risks. Furthermore, we discuss how the implementation remains agnostic to the choice of container platform, allowing it to run within popular platforms such as Singularity and Docker.
id oai-inspirehep.net-1832107
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling oai-inspirehep.net-18321072021-03-04T20:31:41Zdoi:10.1051/epjconf/202024507052http://cds.cern.ch/record/2753509engStoretvedt, MaximBetev, LatchezarHelstrup, HåvardHetland, Kristin FanebustKileng, BjarteRunning ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid frameworkComputing and ComputersThe new JAliEn (Java ALICE Environment) middleware is a Grid framework designed to satisfy the needs of the ALICE experiment for the LHC Run 3, such as providing a high-performance and high-scalability service to cope with the increased volumes of collected data. This new framework also introduces a split, two-layered job pilot, creating a new approach to how jobs are handled and executed within the Grid. Each layer runs on a separate JVM, with a separate authentication token, allowing for a finer control of permissions and improved isolation of the payload. Having these separate layers also allows for the execution of job payloads within containers. This allows for the further strengthening of isolation and creates a cohesive environment across computing sites, while avoiding the resource overhead associated with traditional virtualisation.This contribution presents the architecture of the new split job pilot found in JAliEn, and the methods used to achieve the execution of Grid jobs while maintaining reliable communication between layers. Specifically, how this is achieved despite the possibility of a layer being run in a separate container, while retaining isolation and mitigating possible security risks. Furthermore, we discuss how the implementation remains agnostic to the choice of container platform, allowing it to run within popular platforms such as Singularity and Docker.oai:inspirehep.net:18321072020
spellingShingle Computing and Computers
Storetvedt, Maxim
Betev, Latchezar
Helstrup, Håvard
Hetland, Kristin Fanebust
Kileng, Bjarte
Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework
title Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework
title_full Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework
title_fullStr Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework
title_full_unstemmed Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework
title_short Running ALICE Grid Jobs in Containers: A new approach to job execution for the next generation ALICE Grid framework
title_sort running alice grid jobs in containers: a new approach to job execution for the next generation alice grid framework
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024507052
http://cds.cern.ch/record/2753509
work_keys_str_mv AT storetvedtmaxim runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework
AT betevlatchezar runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework
AT helstruphavard runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework
AT hetlandkristinfanebust runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework
AT kilengbjarte runningalicegridjobsincontainersanewapproachtojobexecutionforthenextgenerationalicegridframework