Cargando…
The ocis storage driver - a deconstructed filesystem
<!--HTML-->Looking up files by a stable id is an inefficient operation in most filesystems. While an efficient lookup by file id can be cached inside an OCIS storage provider this cache needs to be kept up to date. By deconstructing a filesystem and storing every node by its uuid we can evade...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2021
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2750552 |
_version_ | 1780969135537127424 |
---|---|
author | Dreyer, Jörn |
author_facet | Dreyer, Jörn |
author_sort | Dreyer, Jörn |
collection | CERN |
description | <!--HTML-->Looking up files by a stable id is an inefficient operation in most filesystems.
While an efficient lookup by file id can be cached inside an OCIS storage provider this cache needs to be kept up to date. By deconstructing a filesystem and storing every node by its uuid we can evade the cache invalidation problem at the cost of more stat requests. The ocis storage driver allows an efficient lookup of file metadata by path and by file id while relying solely on the filesystem as a persistence layer. Furthermore, the layout on disk can be used to implement trash, versions and in the future deduplication. It serves as a blueprint for seperating metadata and content in an S3 or librados storage driver. |
id | cern-2750552 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2021 |
record_format | invenio |
spelling | cern-27505522022-11-02T22:25:55Zhttp://cds.cern.ch/record/2750552engDreyer, JörnThe ocis storage driver - a deconstructed filesystemCS3 2021- Cloud Storage Synchronization and SharingHEP Computing<!--HTML-->Looking up files by a stable id is an inefficient operation in most filesystems. While an efficient lookup by file id can be cached inside an OCIS storage provider this cache needs to be kept up to date. By deconstructing a filesystem and storing every node by its uuid we can evade the cache invalidation problem at the cost of more stat requests. The ocis storage driver allows an efficient lookup of file metadata by path and by file id while relying solely on the filesystem as a persistence layer. Furthermore, the layout on disk can be used to implement trash, versions and in the future deduplication. It serves as a blueprint for seperating metadata and content in an S3 or librados storage driver.oai:cds.cern.ch:27505522021 |
spellingShingle | HEP Computing Dreyer, Jörn The ocis storage driver - a deconstructed filesystem |
title | The ocis storage driver - a deconstructed filesystem |
title_full | The ocis storage driver - a deconstructed filesystem |
title_fullStr | The ocis storage driver - a deconstructed filesystem |
title_full_unstemmed | The ocis storage driver - a deconstructed filesystem |
title_short | The ocis storage driver - a deconstructed filesystem |
title_sort | ocis storage driver - a deconstructed filesystem |
topic | HEP Computing |
url | http://cds.cern.ch/record/2750552 |
work_keys_str_mv | AT dreyerjorn theocisstoragedriveradeconstructedfilesystem AT dreyerjorn cs32021cloudstoragesynchronizationandsharing AT dreyerjorn ocisstoragedriveradeconstructedfilesystem |