Comparison between CephFS, CFFS (Comtrade FastFS), HDFS (Apache Hadoop), GPFS (IBM Spectrum Scale), Lustre

<!--HTML-->Different high-performance, high-available file systems can store big data (hundreds of PB) and provide high data throughput (hundreds of TB per second). Each of these solutions highlights its advantages, and it is challenging to compare them. Based on 30 years of storage developm...

Descripción completa

Detalles Bibliográficos
Autor principal: Molan, Gregor
Lenguaje:eng
Publicado: 2023
Materias:
HEP Computing
Acceso en línea:http://cds.cern.ch/record/2855373
_version_ 1780977454301577216
author Molan, Gregor
author_facet Molan, Gregor
author_sort Molan, Gregor
collection CERN
description <!--HTML-->Different high-performance, high-available file systems can store big data (hundreds of PB) and provide high data throughput (hundreds of TB per second). Each of these solutions highlights its advantages, and it is challenging to compare them. Based on 30 years of storage development experience, Comtrade provided test scenarios to compare these file systems. On the appropriate high-performance hardware, here are the results from January 2023 that helps companies to choose appropriate high-performance file systems that fulfil given requirements. The limitation of this comparison is limited only to performance, while other essential features, such as software maintenance and upgradeability, are not covered in this comparison.
id cern-2855373
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28553732023-04-03T19:01:41Zhttp://cds.cern.ch/record/2855373engMolan, GregorComparison between CephFS, CFFS (Comtrade FastFS), HDFS (Apache Hadoop), GPFS (IBM Spectrum Scale), LustreCS3 2023 - Cloud Storage Synchronization and SharingHEP Computing<!--HTML-->Different high-performance, high-available file systems can store big data (hundreds of PB) and provide high data throughput (hundreds of TB per second). Each of these solutions highlights its advantages, and it is challenging to compare them. Based on 30 years of storage development experience, Comtrade provided test scenarios to compare these file systems. On the appropriate high-performance hardware, here are the results from January 2023 that helps companies to choose appropriate high-performance file systems that fulfil given requirements. The limitation of this comparison is limited only to performance, while other essential features, such as software maintenance and upgradeability, are not covered in this comparison.oai:cds.cern.ch:28553732023
spellingShingle HEP Computing
Molan, Gregor
Comparison between CephFS, CFFS (Comtrade FastFS), HDFS (Apache Hadoop), GPFS (IBM Spectrum Scale), Lustre
title Comparison between CephFS, CFFS (Comtrade FastFS), HDFS (Apache Hadoop), GPFS (IBM Spectrum Scale), Lustre
title_full Comparison between CephFS, CFFS (Comtrade FastFS), HDFS (Apache Hadoop), GPFS (IBM Spectrum Scale), Lustre
title_fullStr Comparison between CephFS, CFFS (Comtrade FastFS), HDFS (Apache Hadoop), GPFS (IBM Spectrum Scale), Lustre
title_full_unstemmed Comparison between CephFS, CFFS (Comtrade FastFS), HDFS (Apache Hadoop), GPFS (IBM Spectrum Scale), Lustre
title_short Comparison between CephFS, CFFS (Comtrade FastFS), HDFS (Apache Hadoop), GPFS (IBM Spectrum Scale), Lustre
title_sort comparison between cephfs, cffs (comtrade fastfs), hdfs (apache hadoop), gpfs (ibm spectrum scale), lustre
topic HEP Computing
url http://cds.cern.ch/record/2855373
work_keys_str_mv AT molangregor comparisonbetweencephfscffscomtradefastfshdfsapachehadoopgpfsibmspectrumscalelustre
AT molangregor cs32023cloudstoragesynchronizationandsharing

Ejemplares similares