Cargando…

The SIMPLE Framework for deploying containerized grid services

The Worldwide LHC Computing Grid (WLCG) currently has about 170 sites. In order to support WLCG workloads, each site has to deploy and maintain a number of possibly complex grid services. Quite often, site managers require assistance of WLCG experts, for example when new software versions need to be...

Descripción completa

Detalles Bibliográficos
Autores principales: Sharma, Mayank, Junior, Eraldo Silva, Vasilev, Boris Iliev, Litmaath, Maarten, Santana, Renato
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024507017
http://cds.cern.ch/record/2752530
_version_ 1780969333605793792
author Sharma, Mayank
Junior, Eraldo Silva
Vasilev, Boris Iliev
Litmaath, Maarten
Santana, Renato
author_facet Sharma, Mayank
Junior, Eraldo Silva
Vasilev, Boris Iliev
Litmaath, Maarten
Santana, Renato
author_sort Sharma, Mayank
collection CERN
description The Worldwide LHC Computing Grid (WLCG) currently has about 170 sites. In order to support WLCG workloads, each site has to deploy and maintain a number of possibly complex grid services. Quite often, site managers require assistance of WLCG experts, for example when new software versions need to be deployed. Modern configuration management (e.g. Puppet, Ansible), container orchestration (e.g. Docker Swarm, Kubernetes) and containerization technologies (e.g. Docker, Podman) can help make such activities more lightweight by means of packaging sensible configurations of grid services and providing simple mechanisms to distribute and deploy them across the infrastructure available at a site. This article describes the SIMPLE project: a Solution for Installation, Management and Provisioning of Lightweight Elements. The SIMPLE framework leverages modern infrastructure management tools to deploy containerized grid services, such as popular compute elements (e.g. HTCondor, ARC), batch systems (e.g. HTCondor, Slurm), worker nodes, etc. Its architecture follows principles of sustainability, scalability and extensibility. We describe how system administrators can use the framework, as well as the first results, featuring the migration of computing resources to HTCondor at 2 sites. We conclude with an outlook on further developments.
id oai-inspirehep.net-1832205
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling oai-inspirehep.net-18322052021-02-22T19:39:29Zdoi:10.1051/epjconf/202024507017http://cds.cern.ch/record/2752530engSharma, MayankJunior, Eraldo SilvaVasilev, Boris IlievLitmaath, MaartenSantana, RenatoThe SIMPLE Framework for deploying containerized grid servicesComputing and ComputersThe Worldwide LHC Computing Grid (WLCG) currently has about 170 sites. In order to support WLCG workloads, each site has to deploy and maintain a number of possibly complex grid services. Quite often, site managers require assistance of WLCG experts, for example when new software versions need to be deployed. Modern configuration management (e.g. Puppet, Ansible), container orchestration (e.g. Docker Swarm, Kubernetes) and containerization technologies (e.g. Docker, Podman) can help make such activities more lightweight by means of packaging sensible configurations of grid services and providing simple mechanisms to distribute and deploy them across the infrastructure available at a site. This article describes the SIMPLE project: a Solution for Installation, Management and Provisioning of Lightweight Elements. The SIMPLE framework leverages modern infrastructure management tools to deploy containerized grid services, such as popular compute elements (e.g. HTCondor, ARC), batch systems (e.g. HTCondor, Slurm), worker nodes, etc. Its architecture follows principles of sustainability, scalability and extensibility. We describe how system administrators can use the framework, as well as the first results, featuring the migration of computing resources to HTCondor at 2 sites. We conclude with an outlook on further developments.oai:inspirehep.net:18322052020
spellingShingle Computing and Computers
Sharma, Mayank
Junior, Eraldo Silva
Vasilev, Boris Iliev
Litmaath, Maarten
Santana, Renato
The SIMPLE Framework for deploying containerized grid services
title The SIMPLE Framework for deploying containerized grid services
title_full The SIMPLE Framework for deploying containerized grid services
title_fullStr The SIMPLE Framework for deploying containerized grid services
title_full_unstemmed The SIMPLE Framework for deploying containerized grid services
title_short The SIMPLE Framework for deploying containerized grid services
title_sort simple framework for deploying containerized grid services
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024507017
http://cds.cern.ch/record/2752530
work_keys_str_mv AT sharmamayank thesimpleframeworkfordeployingcontainerizedgridservices
AT junioreraldosilva thesimpleframeworkfordeployingcontainerizedgridservices
AT vasilevborisiliev thesimpleframeworkfordeployingcontainerizedgridservices
AT litmaathmaarten thesimpleframeworkfordeployingcontainerizedgridservices
AT santanarenato thesimpleframeworkfordeployingcontainerizedgridservices
AT sharmamayank simpleframeworkfordeployingcontainerizedgridservices
AT junioreraldosilva simpleframeworkfordeployingcontainerizedgridservices
AT vasilevborisiliev simpleframeworkfordeployingcontainerizedgridservices
AT litmaathmaarten simpleframeworkfordeployingcontainerizedgridservices
AT santanarenato simpleframeworkfordeployingcontainerizedgridservices