Cargando…
Migration of CMSWEB cluster at CERN to Kubernetes
The CMS experiment heavily relies on the CMSWEB cluster to host critical services for its operational needs. The cluster is deployed on virtual machines (VMs) from the CERN OpenStack cloud and is manually maintained by operators and developers. The release cycle is composed of several steps, from bu...
Autores principales: | , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2792640 |
_version_ | 1780972380998336512 |
---|---|
author | Imran, Muhammad Kuznetsov, Valentin Lina Marcella Dziedziniewicz, Katarzyna Maria Dziedziniewicz, Katarzyna Maria Pfeiffer, Andreas Paparrigopoulos, Panos |
author_facet | Imran, Muhammad Kuznetsov, Valentin Lina Marcella Dziedziniewicz, Katarzyna Maria Dziedziniewicz, Katarzyna Maria Pfeiffer, Andreas Paparrigopoulos, Panos |
author_sort | Imran, Muhammad |
collection | CERN |
description | The CMS experiment heavily relies on the CMSWEB cluster to host critical services for its operational needs. The cluster is deployed on virtual machines (VMs) from the CERN OpenStack cloud and is manually maintained by operators and developers. The release cycle is composed of several steps, from building RPMs, their deployment to perform validation, and integration tests. To enhance the sustainability of the CMSWEB cluster, CMS decided to migrate its cluster to a containerized solution such as Docker, orchestrated with Kubernetes (k8s). This allows us to significantly reduce the release upgrade cycle, follow the end-to-end deployment procedure, and reduce operational cost. This paper gives an overview of the current CMSWEB cluster and its issues. We describe the new architecture of the CMSWEB cluster in Kubernetes. We also provide a comparison of VM and Kubernetes deployment approaches and report on lessons learned during the migration process. |
id | cern-2792640 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | cern-27926402021-12-10T19:48:20Zhttp://cds.cern.ch/record/2792640engImran, MuhammadKuznetsov, ValentinLina MarcellaDziedziniewicz, Katarzyna MariaDziedziniewicz, Katarzyna MariaPfeiffer, AndreasPaparrigopoulos, PanosMigration of CMSWEB cluster at CERN to KubernetesDetectors and Experimental TechniquesThe CMS experiment heavily relies on the CMSWEB cluster to host critical services for its operational needs. The cluster is deployed on virtual machines (VMs) from the CERN OpenStack cloud and is manually maintained by operators and developers. The release cycle is composed of several steps, from building RPMs, their deployment to perform validation, and integration tests. To enhance the sustainability of the CMSWEB cluster, CMS decided to migrate its cluster to a containerized solution such as Docker, orchestrated with Kubernetes (k8s). This allows us to significantly reduce the release upgrade cycle, follow the end-to-end deployment procedure, and reduce operational cost. This paper gives an overview of the current CMSWEB cluster and its issues. We describe the new architecture of the CMSWEB cluster in Kubernetes. We also provide a comparison of VM and Kubernetes deployment approaches and report on lessons learned during the migration process.CMS-CR-2020-153oai:cds.cern.ch:27926402020-09-29 |
spellingShingle | Detectors and Experimental Techniques Imran, Muhammad Kuznetsov, Valentin Lina Marcella Dziedziniewicz, Katarzyna Maria Dziedziniewicz, Katarzyna Maria Pfeiffer, Andreas Paparrigopoulos, Panos Migration of CMSWEB cluster at CERN to Kubernetes |
title | Migration of CMSWEB cluster at CERN to Kubernetes |
title_full | Migration of CMSWEB cluster at CERN to Kubernetes |
title_fullStr | Migration of CMSWEB cluster at CERN to Kubernetes |
title_full_unstemmed | Migration of CMSWEB cluster at CERN to Kubernetes |
title_short | Migration of CMSWEB cluster at CERN to Kubernetes |
title_sort | migration of cmsweb cluster at cern to kubernetes |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/2792640 |
work_keys_str_mv | AT imranmuhammad migrationofcmswebclusteratcerntokubernetes AT kuznetsovvalentin migrationofcmswebclusteratcerntokubernetes AT linamarcella migrationofcmswebclusteratcerntokubernetes AT dziedziniewiczkatarzynamaria migrationofcmswebclusteratcerntokubernetes AT dziedziniewiczkatarzynamaria migrationofcmswebclusteratcerntokubernetes AT pfeifferandreas migrationofcmswebclusteratcerntokubernetes AT paparrigopoulospanos migrationofcmswebclusteratcerntokubernetes |