Cargando…

Migration of CMSWEB cluster at CERN to Kubernetes

The CMS experiment heavily relies on the CMSWEB cluster to host critical services for its operational needs. The cluster is deployed on virtual machines (VMs) from the CERN OpenStack cloud and is manually maintained by operators and developers. The release cycle is composed of several steps, from bu...

Descripción completa

Detalles Bibliográficos
Autores principales: Imran, Muhammad, Kuznetsov, Valentin, Lina Marcella, Dziedziniewicz, Katarzyna Maria, Pfeiffer, Andreas, Paparrigopoulos, Panos
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:http://cds.cern.ch/record/2792640
_version_ 1780972380998336512
author Imran, Muhammad
Kuznetsov, Valentin
Lina Marcella
Dziedziniewicz, Katarzyna Maria
Dziedziniewicz, Katarzyna Maria
Pfeiffer, Andreas
Paparrigopoulos, Panos
author_facet Imran, Muhammad
Kuznetsov, Valentin
Lina Marcella
Dziedziniewicz, Katarzyna Maria
Dziedziniewicz, Katarzyna Maria
Pfeiffer, Andreas
Paparrigopoulos, Panos
author_sort Imran, Muhammad
collection CERN
description The CMS experiment heavily relies on the CMSWEB cluster to host critical services for its operational needs. The cluster is deployed on virtual machines (VMs) from the CERN OpenStack cloud and is manually maintained by operators and developers. The release cycle is composed of several steps, from building RPMs, their deployment to perform validation, and integration tests. To enhance the sustainability of the CMSWEB cluster, CMS decided to migrate its cluster to a containerized solution such as Docker, orchestrated with Kubernetes (k8s). This allows us to significantly reduce the release upgrade cycle, follow the end-to-end deployment procedure, and reduce operational cost. This paper gives an overview of the current CMSWEB cluster and its issues. We describe the new architecture of the CMSWEB cluster in Kubernetes. We also provide a comparison of VM and Kubernetes deployment approaches and report on lessons learned during the migration process.
id cern-2792640
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling cern-27926402021-12-10T19:48:20Zhttp://cds.cern.ch/record/2792640engImran, MuhammadKuznetsov, ValentinLina MarcellaDziedziniewicz, Katarzyna MariaDziedziniewicz, Katarzyna MariaPfeiffer, AndreasPaparrigopoulos, PanosMigration of CMSWEB cluster at CERN to KubernetesDetectors and Experimental TechniquesThe CMS experiment heavily relies on the CMSWEB cluster to host critical services for its operational needs. The cluster is deployed on virtual machines (VMs) from the CERN OpenStack cloud and is manually maintained by operators and developers. The release cycle is composed of several steps, from building RPMs, their deployment to perform validation, and integration tests. To enhance the sustainability of the CMSWEB cluster, CMS decided to migrate its cluster to a containerized solution such as Docker, orchestrated with Kubernetes (k8s). This allows us to significantly reduce the release upgrade cycle, follow the end-to-end deployment procedure, and reduce operational cost. This paper gives an overview of the current CMSWEB cluster and its issues. We describe the new architecture of the CMSWEB cluster in Kubernetes. We also provide a comparison of VM and Kubernetes deployment approaches and report on lessons learned during the migration process.CMS-CR-2020-153oai:cds.cern.ch:27926402020-09-29
spellingShingle Detectors and Experimental Techniques
Imran, Muhammad
Kuznetsov, Valentin
Lina Marcella
Dziedziniewicz, Katarzyna Maria
Dziedziniewicz, Katarzyna Maria
Pfeiffer, Andreas
Paparrigopoulos, Panos
Migration of CMSWEB cluster at CERN to Kubernetes
title Migration of CMSWEB cluster at CERN to Kubernetes
title_full Migration of CMSWEB cluster at CERN to Kubernetes
title_fullStr Migration of CMSWEB cluster at CERN to Kubernetes
title_full_unstemmed Migration of CMSWEB cluster at CERN to Kubernetes
title_short Migration of CMSWEB cluster at CERN to Kubernetes
title_sort migration of cmsweb cluster at cern to kubernetes
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/2792640
work_keys_str_mv AT imranmuhammad migrationofcmswebclusteratcerntokubernetes
AT kuznetsovvalentin migrationofcmswebclusteratcerntokubernetes
AT linamarcella migrationofcmswebclusteratcerntokubernetes
AT dziedziniewiczkatarzynamaria migrationofcmswebclusteratcerntokubernetes
AT dziedziniewiczkatarzynamaria migrationofcmswebclusteratcerntokubernetes
AT pfeifferandreas migrationofcmswebclusteratcerntokubernetes
AT paparrigopoulospanos migrationofcmswebclusteratcerntokubernetes