Cargando…
Exploration of GPU-enabled lossless compressors
The CMS collaboration has a growing interest in the use of heterogeneous computing and accelerators to reduce the costs and improve the efficiency of the online and offline data processing: online, the High Level Trigger is fully equipped with NVIDIA GPUs; offline, a growing fraction of the computin...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2022
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2825247 |
_version_ | 1780973760349732864 |
---|---|
author | Rua, Stefan |
author_facet | Rua, Stefan |
author_sort | Rua, Stefan |
collection | CERN |
description | The CMS collaboration has a growing interest in the use of heterogeneous computing and accelerators to reduce the costs and improve the efficiency of the online and offline data processing: online, the High Level Trigger is fully equipped with NVIDIA GPUs; offline, a growing fraction of the computing power is coming from GPU-equipped HPC centres. One of the topics where accelerators could be used for both online and offline processing is data compression. In the past decade a number of research papers exploring the use of GPUs for lossless data compression have appeared in academic literature, but very few practical application have emerged. In the industry, NVIDIA has recently published the nvcomp GPU-accelerated data compression library, based on closed-source implementations of standard and dedicated algorithms. Other platforms, like the IBM Power 9 processors, offer dedicated hardware for the acceleration data compression tasks. In this work we review the recent developments on the use of accelerators for data compression. After summarising the recent academic research, we will measure the performance of representative open- and closed-source algorithms over CMS data, and compare it with the CPU-only algorithms currently used by ROOT and CMS (lz4, zlib, zstd). |
id | cern-2825247 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2022 |
record_format | invenio |
spelling | cern-28252472022-08-24T20:18:13Zhttp://cds.cern.ch/record/2825247engRua, StefanExploration of GPU-enabled lossless compressorsComputing and ComputersThe CMS collaboration has a growing interest in the use of heterogeneous computing and accelerators to reduce the costs and improve the efficiency of the online and offline data processing: online, the High Level Trigger is fully equipped with NVIDIA GPUs; offline, a growing fraction of the computing power is coming from GPU-equipped HPC centres. One of the topics where accelerators could be used for both online and offline processing is data compression. In the past decade a number of research papers exploring the use of GPUs for lossless data compression have appeared in academic literature, but very few practical application have emerged. In the industry, NVIDIA has recently published the nvcomp GPU-accelerated data compression library, based on closed-source implementations of standard and dedicated algorithms. Other platforms, like the IBM Power 9 processors, offer dedicated hardware for the acceleration data compression tasks. In this work we review the recent developments on the use of accelerators for data compression. After summarising the recent academic research, we will measure the performance of representative open- and closed-source algorithms over CMS data, and compare it with the CPU-only algorithms currently used by ROOT and CMS (lz4, zlib, zstd).CERN-STUDENTS-Note-2022-065oai:cds.cern.ch:28252472022-08-24 |
spellingShingle | Computing and Computers Rua, Stefan Exploration of GPU-enabled lossless compressors |
title | Exploration of GPU-enabled lossless compressors |
title_full | Exploration of GPU-enabled lossless compressors |
title_fullStr | Exploration of GPU-enabled lossless compressors |
title_full_unstemmed | Exploration of GPU-enabled lossless compressors |
title_short | Exploration of GPU-enabled lossless compressors |
title_sort | exploration of gpu-enabled lossless compressors |
topic | Computing and Computers |
url | http://cds.cern.ch/record/2825247 |
work_keys_str_mv | AT ruastefan explorationofgpuenabledlosslesscompressors |