Cargando…

Evaluation of the Suitability of Alluxio for Hadoop Processing Frameworks

Alluxio is an open source memory speed virtual distributed storage platform. It sits between the storage and processing framework layers for big data processing and claims to heavily improve performance when data is required to be written/read at a high throughput; for example when a dataset is used...

Descripción completa

Detalles Bibliográficos
Autores principales: Lawrie, Christopher, Kothuri, Prasanth
Lenguaje:eng
Publicado: 2016
Materias:
Acceso en línea:http://cds.cern.ch/record/2216180
_version_ 1780952040750448640
author Lawrie, Christopher
Kothuri, Prasanth
author_facet Lawrie, Christopher
Kothuri, Prasanth
author_sort Lawrie, Christopher
collection CERN
description Alluxio is an open source memory speed virtual distributed storage platform. It sits between the storage and processing framework layers for big data processing and claims to heavily improve performance when data is required to be written/read at a high throughput; for example when a dataset is used by many jobs simultaneously. This report evaluates the viability of using Alluxio at CERN for Hadoop processing frameworks.
id cern-2216180
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2016
record_format invenio
spelling cern-22161802019-09-30T06:29:59Zhttp://cds.cern.ch/record/2216180engLawrie, ChristopherKothuri, PrasanthEvaluation of the Suitability of Alluxio for Hadoop Processing FrameworksInformation Transfer and ManagementComputing and ComputersAlluxio is an open source memory speed virtual distributed storage platform. It sits between the storage and processing framework layers for big data processing and claims to heavily improve performance when data is required to be written/read at a high throughput; for example when a dataset is used by many jobs simultaneously. This report evaluates the viability of using Alluxio at CERN for Hadoop processing frameworks.CERN-STUDENTS-Note-2016-216oai:cds.cern.ch:22161802016-09-16
spellingShingle Information Transfer and Management
Computing and Computers
Lawrie, Christopher
Kothuri, Prasanth
Evaluation of the Suitability of Alluxio for Hadoop Processing Frameworks
title Evaluation of the Suitability of Alluxio for Hadoop Processing Frameworks
title_full Evaluation of the Suitability of Alluxio for Hadoop Processing Frameworks
title_fullStr Evaluation of the Suitability of Alluxio for Hadoop Processing Frameworks
title_full_unstemmed Evaluation of the Suitability of Alluxio for Hadoop Processing Frameworks
title_short Evaluation of the Suitability of Alluxio for Hadoop Processing Frameworks
title_sort evaluation of the suitability of alluxio for hadoop processing frameworks
topic Information Transfer and Management
Computing and Computers
url http://cds.cern.ch/record/2216180
work_keys_str_mv AT lawriechristopher evaluationofthesuitabilityofalluxioforhadoopprocessingframeworks
AT kothuriprasanth evaluationofthesuitabilityofalluxioforhadoopprocessingframeworks