Cargando…

The ocis storage driver - a deconstructed filesystem

<!--HTML-->Looking up files by a stable id is an inefficient operation in most filesystems. While an efficient lookup by file id can be cached inside an OCIS storage provider this cache needs to be kept up to date. By deconstructing a filesystem and storing every node by its uuid we can evade...

Descripción completa

Detalles Bibliográficos
Autor principal: Dreyer, Jörn
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2750552
_version_ 1780969135537127424
author Dreyer, Jörn
author_facet Dreyer, Jörn
author_sort Dreyer, Jörn
collection CERN
description <!--HTML-->Looking up files by a stable id is an inefficient operation in most filesystems. While an efficient lookup by file id can be cached inside an OCIS storage provider this cache needs to be kept up to date. By deconstructing a filesystem and storing every node by its uuid we can evade the cache invalidation problem at the cost of more stat requests. The ocis storage driver allows an efficient lookup of file metadata by path and by file id while relying solely on the filesystem as a persistence layer. Furthermore, the layout on disk can be used to implement trash, versions and in the future deduplication. It serves as a blueprint for seperating metadata and content in an S3 or librados storage driver.
id cern-2750552
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27505522022-11-02T22:25:55Zhttp://cds.cern.ch/record/2750552engDreyer, JörnThe ocis storage driver - a deconstructed filesystemCS3 2021- Cloud Storage Synchronization and SharingHEP Computing<!--HTML-->Looking up files by a stable id is an inefficient operation in most filesystems. While an efficient lookup by file id can be cached inside an OCIS storage provider this cache needs to be kept up to date. By deconstructing a filesystem and storing every node by its uuid we can evade the cache invalidation problem at the cost of more stat requests. The ocis storage driver allows an efficient lookup of file metadata by path and by file id while relying solely on the filesystem as a persistence layer. Furthermore, the layout on disk can be used to implement trash, versions and in the future deduplication. It serves as a blueprint for seperating metadata and content in an S3 or librados storage driver.oai:cds.cern.ch:27505522021
spellingShingle HEP Computing
Dreyer, Jörn
The ocis storage driver - a deconstructed filesystem
title The ocis storage driver - a deconstructed filesystem
title_full The ocis storage driver - a deconstructed filesystem
title_fullStr The ocis storage driver - a deconstructed filesystem
title_full_unstemmed The ocis storage driver - a deconstructed filesystem
title_short The ocis storage driver - a deconstructed filesystem
title_sort ocis storage driver - a deconstructed filesystem
topic HEP Computing
url http://cds.cern.ch/record/2750552
work_keys_str_mv AT dreyerjorn theocisstoragedriveradeconstructedfilesystem
AT dreyerjorn cs32021cloudstoragesynchronizationandsharing
AT dreyerjorn ocisstoragedriveradeconstructedfilesystem