Cargando…

Genozip: a universal extensible genomic data compressor

 : We present Genozip, a universal and fully featured compression software for genomic data. Genozip is designed to be a general-purpose software and a development framework for genomic compression by providing five core capabilities—universality (support for all common genomic file formats), high c...

Descripción completa

Detalles Bibliográficos
Autores principales: Lan, Divon, Tobler, Ray, Souilmi, Yassine, Llamas, Bastien
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8388020/
https://www.ncbi.nlm.nih.gov/pubmed/33585897
http://dx.doi.org/10.1093/bioinformatics/btab102
_version_ 1783742560873742336
author Lan, Divon
Tobler, Ray
Souilmi, Yassine
Llamas, Bastien
author_facet Lan, Divon
Tobler, Ray
Souilmi, Yassine
Llamas, Bastien
author_sort Lan, Divon
collection PubMed
description  : We present Genozip, a universal and fully featured compression software for genomic data. Genozip is designed to be a general-purpose software and a development framework for genomic compression by providing five core capabilities—universality (support for all common genomic file formats), high compression ratios, speed, feature-richness and extensibility. Genozip delivers high-performance compression for widelyused genomic data formats in genomics research, namely FASTQ, SAM/BAM/CRAM, VCF, GVF, FASTA, PHYLIP and 23andMe formats. Our test results show that Genozip is fast and achieves greatly improved compression ratios, even when the files are already compressed. Further, Genozip is architected with a separation of the Genozip Framework from file-format-specific Segmenters and data-type-specific Codecs. With this, we intend for Genozip to be a general-purpose compression platform where researchers can implement compression for additional file formats, as well as new codecs for data types or fields within files, in the future. We anticipate that this will ultimately increase the visibility and adoption of these algorithms by the user community, thereby accelerating further innovation in this space. AVAILABILITY AND IMPLEMENTATION: Genozip is written in C. The code is open-source and available on http://www.genozip.com. The package is free for non-commercial use. It is distributed through the Conda package manager, github, and as a Docker container on DockerHub. Genozip is tested on Linux, Mac and Windows. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
format Online
Article
Text
id pubmed-8388020
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-83880202021-08-26 Genozip: a universal extensible genomic data compressor Lan, Divon Tobler, Ray Souilmi, Yassine Llamas, Bastien Bioinformatics Original Papers  : We present Genozip, a universal and fully featured compression software for genomic data. Genozip is designed to be a general-purpose software and a development framework for genomic compression by providing five core capabilities—universality (support for all common genomic file formats), high compression ratios, speed, feature-richness and extensibility. Genozip delivers high-performance compression for widelyused genomic data formats in genomics research, namely FASTQ, SAM/BAM/CRAM, VCF, GVF, FASTA, PHYLIP and 23andMe formats. Our test results show that Genozip is fast and achieves greatly improved compression ratios, even when the files are already compressed. Further, Genozip is architected with a separation of the Genozip Framework from file-format-specific Segmenters and data-type-specific Codecs. With this, we intend for Genozip to be a general-purpose compression platform where researchers can implement compression for additional file formats, as well as new codecs for data types or fields within files, in the future. We anticipate that this will ultimately increase the visibility and adoption of these algorithms by the user community, thereby accelerating further innovation in this space. AVAILABILITY AND IMPLEMENTATION: Genozip is written in C. The code is open-source and available on http://www.genozip.com. The package is free for non-commercial use. It is distributed through the Conda package manager, github, and as a Docker container on DockerHub. Genozip is tested on Linux, Mac and Windows. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online. Oxford University Press 2021-02-15 /pmc/articles/PMC8388020/ /pubmed/33585897 http://dx.doi.org/10.1093/bioinformatics/btab102 Text en © The Author(s) 2021. Published by Oxford University Press. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Original Papers
Lan, Divon
Tobler, Ray
Souilmi, Yassine
Llamas, Bastien
Genozip: a universal extensible genomic data compressor
title Genozip: a universal extensible genomic data compressor
title_full Genozip: a universal extensible genomic data compressor
title_fullStr Genozip: a universal extensible genomic data compressor
title_full_unstemmed Genozip: a universal extensible genomic data compressor
title_short Genozip: a universal extensible genomic data compressor
title_sort genozip: a universal extensible genomic data compressor
topic Original Papers
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8388020/
https://www.ncbi.nlm.nih.gov/pubmed/33585897
http://dx.doi.org/10.1093/bioinformatics/btab102
work_keys_str_mv AT landivon genozipauniversalextensiblegenomicdatacompressor
AT toblerray genozipauniversalextensiblegenomicdatacompressor
AT souilmiyassine genozipauniversalextensiblegenomicdatacompressor
AT llamasbastien genozipauniversalextensiblegenomicdatacompressor