Cargando…

Experience of using EOS LRU and File Converter engines for write buffering in the Data Lake prototype

<!--HTML-->In this talk we will share our experience in implementing write buffering with background stage-out of files from a site accessing the Data Lake prototype using EOS built-in LRU and File Converter engines. This study was aimed at improving resource usage for CPU-only sites by reduci...

Descripción completa

Detalles Bibliográficos
Autor principal: Kirianov, Andrey
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2753697
_version_ 1780969365516058624
author Kirianov, Andrey
author_facet Kirianov, Andrey
author_sort Kirianov, Andrey
collection CERN
description <!--HTML-->In this talk we will share our experience in implementing write buffering with background stage-out of files from a site accessing the Data Lake prototype using EOS built-in LRU and File Converter engines. This study was aimed at improving resource usage for CPU-only sites by reducing the data stage-out overhead.
id cern-2753697
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27536972022-11-02T22:19:20Zhttp://cds.cern.ch/record/2753697engKirianov, AndreyExperience of using EOS LRU and File Converter engines for write buffering in the Data Lake prototypeEOS workshopHEP Computing<!--HTML-->In this talk we will share our experience in implementing write buffering with background stage-out of files from a site accessing the Data Lake prototype using EOS built-in LRU and File Converter engines. This study was aimed at improving resource usage for CPU-only sites by reducing the data stage-out overhead.oai:cds.cern.ch:27536972021
spellingShingle HEP Computing
Kirianov, Andrey
Experience of using EOS LRU and File Converter engines for write buffering in the Data Lake prototype
title Experience of using EOS LRU and File Converter engines for write buffering in the Data Lake prototype
title_full Experience of using EOS LRU and File Converter engines for write buffering in the Data Lake prototype
title_fullStr Experience of using EOS LRU and File Converter engines for write buffering in the Data Lake prototype
title_full_unstemmed Experience of using EOS LRU and File Converter engines for write buffering in the Data Lake prototype
title_short Experience of using EOS LRU and File Converter engines for write buffering in the Data Lake prototype
title_sort experience of using eos lru and file converter engines for write buffering in the data lake prototype
topic HEP Computing
url http://cds.cern.ch/record/2753697
work_keys_str_mv AT kirianovandrey experienceofusingeoslruandfileconverterenginesforwritebufferinginthedatalakeprototype
AT kirianovandrey eosworkshop