Cargando…

Towards a serverless CernVM-FS

The CernVM File System (CernVM-FS) provides a scalable and reliable software distribution and—to some extent—a data distribution service. It gives POSIX access to more than a billion binary files of experiment application software stacks and operating system containers to end user devices, grids, cl...

Descripción completa

Detalles Bibliográficos
Autores principales: Blomer, Jakob, Ganis, Gerardo, Mosciatti, Simone, Popescu, Radu
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921409007
http://cds.cern.ch/record/2698541
_version_ 1780964343736696832
author Blomer, Jakob
Ganis, Gerardo
Mosciatti, Simone
Popescu, Radu
author_facet Blomer, Jakob
Ganis, Gerardo
Mosciatti, Simone
Popescu, Radu
author_sort Blomer, Jakob
collection CERN
description The CernVM File System (CernVM-FS) provides a scalable and reliable software distribution and—to some extent—a data distribution service. It gives POSIX access to more than a billion binary files of experiment application software stacks and operating system containers to end user devices, grids, clouds, and supercomputers. Increasingly, CernVM-FS also provides access to certain classes of data, such as detector conditions data, genomics reference sets, or gravitational wave detector experiment data. For most of the high-energy physics experiments, an underlying HTTP content distribution infrastructure is jointly provided by universities and research institutes around the world. In this contribution, we will present recent developments and future plans. For future developments, we put a focus on evolving the content distribution infrastructure and at lowering the barrier for publishing into CernVM-FS. Through so-called serverless computing, we envision cloud hosted CernVM-FS repositories without the need to operate dedicated servers or virtual machines. An S3 compatible service in conjunction with a content delivery network takes on data provisioning, replication, and caching. A chain of time-limited and resource-limited functions (so called “lambda function” or “function-as-a-service”) operate on the repository and stage the updates. As a result, any CernVM-FS client should be able to turn into a writer, possession of suitable keys provided. For repository owners, we aim at providing cost transparency and seamless scalability from very small to very large CernVM-FS installations.
id oai-inspirehep.net-1761638
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling oai-inspirehep.net-17616382022-08-10T12:25:04Zdoi:10.1051/epjconf/201921409007http://cds.cern.ch/record/2698541engBlomer, JakobGanis, GerardoMosciatti, SimonePopescu, RaduTowards a serverless CernVM-FSComputing and ComputersThe CernVM File System (CernVM-FS) provides a scalable and reliable software distribution and—to some extent—a data distribution service. It gives POSIX access to more than a billion binary files of experiment application software stacks and operating system containers to end user devices, grids, clouds, and supercomputers. Increasingly, CernVM-FS also provides access to certain classes of data, such as detector conditions data, genomics reference sets, or gravitational wave detector experiment data. For most of the high-energy physics experiments, an underlying HTTP content distribution infrastructure is jointly provided by universities and research institutes around the world. In this contribution, we will present recent developments and future plans. For future developments, we put a focus on evolving the content distribution infrastructure and at lowering the barrier for publishing into CernVM-FS. Through so-called serverless computing, we envision cloud hosted CernVM-FS repositories without the need to operate dedicated servers or virtual machines. An S3 compatible service in conjunction with a content delivery network takes on data provisioning, replication, and caching. A chain of time-limited and resource-limited functions (so called “lambda function” or “function-as-a-service”) operate on the repository and stage the updates. As a result, any CernVM-FS client should be able to turn into a writer, possession of suitable keys provided. For repository owners, we aim at providing cost transparency and seamless scalability from very small to very large CernVM-FS installations.oai:inspirehep.net:17616382019
spellingShingle Computing and Computers
Blomer, Jakob
Ganis, Gerardo
Mosciatti, Simone
Popescu, Radu
Towards a serverless CernVM-FS
title Towards a serverless CernVM-FS
title_full Towards a serverless CernVM-FS
title_fullStr Towards a serverless CernVM-FS
title_full_unstemmed Towards a serverless CernVM-FS
title_short Towards a serverless CernVM-FS
title_sort towards a serverless cernvm-fs
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/201921409007
http://cds.cern.ch/record/2698541
work_keys_str_mv AT blomerjakob towardsaserverlesscernvmfs
AT ganisgerardo towardsaserverlesscernvmfs
AT mosciattisimone towardsaserverlesscernvmfs
AT popescuradu towardsaserverlesscernvmfs