Cargando…

Exploration of GPU-enabled lossless compressors

The CMS collaboration has a growing interest in the use of heterogeneous computing and accelerators to reduce the costs and improve the efficiency of the online and offline data processing: online, the High Level Trigger is fully equipped with NVIDIA GPUs; offline, a growing fraction of the computin...

Descripción completa

Detalles Bibliográficos
Autor principal: Rua, Stefan
Lenguaje:eng
Publicado: 2022
Materias:
Acceso en línea:http://cds.cern.ch/record/2825247
_version_ 1780973760349732864
author Rua, Stefan
author_facet Rua, Stefan
author_sort Rua, Stefan
collection CERN
description The CMS collaboration has a growing interest in the use of heterogeneous computing and accelerators to reduce the costs and improve the efficiency of the online and offline data processing: online, the High Level Trigger is fully equipped with NVIDIA GPUs; offline, a growing fraction of the computing power is coming from GPU-equipped HPC centres. One of the topics where accelerators could be used for both online and offline processing is data compression. In the past decade a number of research papers exploring the use of GPUs for lossless data compression have appeared in academic literature, but very few practical application have emerged. In the industry, NVIDIA has recently published the nvcomp GPU-accelerated data compression library, based on closed-source implementations of standard and dedicated algorithms. Other platforms, like the IBM Power 9 processors, offer dedicated hardware for the acceleration data compression tasks. In this work we review the recent developments on the use of accelerators for data compression. After summarising the recent academic research, we will measure the performance of representative open- and closed-source algorithms over CMS data, and compare it with the CPU-only algorithms currently used by ROOT and CMS (lz4, zlib, zstd).
id cern-2825247
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2022
record_format invenio
spelling cern-28252472022-08-24T20:18:13Zhttp://cds.cern.ch/record/2825247engRua, StefanExploration of GPU-enabled lossless compressorsComputing and ComputersThe CMS collaboration has a growing interest in the use of heterogeneous computing and accelerators to reduce the costs and improve the efficiency of the online and offline data processing: online, the High Level Trigger is fully equipped with NVIDIA GPUs; offline, a growing fraction of the computing power is coming from GPU-equipped HPC centres. One of the topics where accelerators could be used for both online and offline processing is data compression. In the past decade a number of research papers exploring the use of GPUs for lossless data compression have appeared in academic literature, but very few practical application have emerged. In the industry, NVIDIA has recently published the nvcomp GPU-accelerated data compression library, based on closed-source implementations of standard and dedicated algorithms. Other platforms, like the IBM Power 9 processors, offer dedicated hardware for the acceleration data compression tasks. In this work we review the recent developments on the use of accelerators for data compression. After summarising the recent academic research, we will measure the performance of representative open- and closed-source algorithms over CMS data, and compare it with the CPU-only algorithms currently used by ROOT and CMS (lz4, zlib, zstd).CERN-STUDENTS-Note-2022-065oai:cds.cern.ch:28252472022-08-24
spellingShingle Computing and Computers
Rua, Stefan
Exploration of GPU-enabled lossless compressors
title Exploration of GPU-enabled lossless compressors
title_full Exploration of GPU-enabled lossless compressors
title_fullStr Exploration of GPU-enabled lossless compressors
title_full_unstemmed Exploration of GPU-enabled lossless compressors
title_short Exploration of GPU-enabled lossless compressors
title_sort exploration of gpu-enabled lossless compressors
topic Computing and Computers
url http://cds.cern.ch/record/2825247
work_keys_str_mv AT ruastefan explorationofgpuenabledlosslesscompressors