Cargando…
Genozip: a universal extensible genomic data compressor
: We present Genozip, a universal and fully featured compression software for genomic data. Genozip is designed to be a general-purpose software and a development framework for genomic compression by providing five core capabilities—universality (support for all common genomic file formats), high c...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8388020/ https://www.ncbi.nlm.nih.gov/pubmed/33585897 http://dx.doi.org/10.1093/bioinformatics/btab102 |
_version_ | 1783742560873742336 |
---|---|
author | Lan, Divon Tobler, Ray Souilmi, Yassine Llamas, Bastien |
author_facet | Lan, Divon Tobler, Ray Souilmi, Yassine Llamas, Bastien |
author_sort | Lan, Divon |
collection | PubMed |
description | : We present Genozip, a universal and fully featured compression software for genomic data. Genozip is designed to be a general-purpose software and a development framework for genomic compression by providing five core capabilities—universality (support for all common genomic file formats), high compression ratios, speed, feature-richness and extensibility. Genozip delivers high-performance compression for widelyused genomic data formats in genomics research, namely FASTQ, SAM/BAM/CRAM, VCF, GVF, FASTA, PHYLIP and 23andMe formats. Our test results show that Genozip is fast and achieves greatly improved compression ratios, even when the files are already compressed. Further, Genozip is architected with a separation of the Genozip Framework from file-format-specific Segmenters and data-type-specific Codecs. With this, we intend for Genozip to be a general-purpose compression platform where researchers can implement compression for additional file formats, as well as new codecs for data types or fields within files, in the future. We anticipate that this will ultimately increase the visibility and adoption of these algorithms by the user community, thereby accelerating further innovation in this space. AVAILABILITY AND IMPLEMENTATION: Genozip is written in C. The code is open-source and available on http://www.genozip.com. The package is free for non-commercial use. It is distributed through the Conda package manager, github, and as a Docker container on DockerHub. Genozip is tested on Linux, Mac and Windows. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online. |
format | Online Article Text |
id | pubmed-8388020 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-83880202021-08-26 Genozip: a universal extensible genomic data compressor Lan, Divon Tobler, Ray Souilmi, Yassine Llamas, Bastien Bioinformatics Original Papers : We present Genozip, a universal and fully featured compression software for genomic data. Genozip is designed to be a general-purpose software and a development framework for genomic compression by providing five core capabilities—universality (support for all common genomic file formats), high compression ratios, speed, feature-richness and extensibility. Genozip delivers high-performance compression for widelyused genomic data formats in genomics research, namely FASTQ, SAM/BAM/CRAM, VCF, GVF, FASTA, PHYLIP and 23andMe formats. Our test results show that Genozip is fast and achieves greatly improved compression ratios, even when the files are already compressed. Further, Genozip is architected with a separation of the Genozip Framework from file-format-specific Segmenters and data-type-specific Codecs. With this, we intend for Genozip to be a general-purpose compression platform where researchers can implement compression for additional file formats, as well as new codecs for data types or fields within files, in the future. We anticipate that this will ultimately increase the visibility and adoption of these algorithms by the user community, thereby accelerating further innovation in this space. AVAILABILITY AND IMPLEMENTATION: Genozip is written in C. The code is open-source and available on http://www.genozip.com. The package is free for non-commercial use. It is distributed through the Conda package manager, github, and as a Docker container on DockerHub. Genozip is tested on Linux, Mac and Windows. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online. Oxford University Press 2021-02-15 /pmc/articles/PMC8388020/ /pubmed/33585897 http://dx.doi.org/10.1093/bioinformatics/btab102 Text en © The Author(s) 2021. Published by Oxford University Press. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Original Papers Lan, Divon Tobler, Ray Souilmi, Yassine Llamas, Bastien Genozip: a universal extensible genomic data compressor |
title | Genozip: a universal extensible genomic data compressor |
title_full | Genozip: a universal extensible genomic data compressor |
title_fullStr | Genozip: a universal extensible genomic data compressor |
title_full_unstemmed | Genozip: a universal extensible genomic data compressor |
title_short | Genozip: a universal extensible genomic data compressor |
title_sort | genozip: a universal extensible genomic data compressor |
topic | Original Papers |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8388020/ https://www.ncbi.nlm.nih.gov/pubmed/33585897 http://dx.doi.org/10.1093/bioinformatics/btab102 |
work_keys_str_mv | AT landivon genozipauniversalextensiblegenomicdatacompressor AT toblerray genozipauniversalextensiblegenomicdatacompressor AT souilmiyassine genozipauniversalextensiblegenomicdatacompressor AT llamasbastien genozipauniversalextensiblegenomicdatacompressor |