Cargando…

Locality-sensitive hashing for the edit distance

MOTIVATION: Sequence alignment is a central operation in bioinformatics pipeline and, despite many improvements, remains a computationally challenging problem. Locality-sensitive hashing (LSH) is one method used to estimate the likelihood of two sequences to have a proper alignment. Using an LSH, it...

Descripción completa

Detalles Bibliográficos
Autores principales: Marçais, Guillaume, DeBlasio, Dan, Pandey, Prashant, Kingsford, Carl
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6612865/
https://www.ncbi.nlm.nih.gov/pubmed/31510667
http://dx.doi.org/10.1093/bioinformatics/btz354
_version_ 1783432954549108736
author Marçais, Guillaume
DeBlasio, Dan
Pandey, Prashant
Kingsford, Carl
author_facet Marçais, Guillaume
DeBlasio, Dan
Pandey, Prashant
Kingsford, Carl
author_sort Marçais, Guillaume
collection PubMed
description MOTIVATION: Sequence alignment is a central operation in bioinformatics pipeline and, despite many improvements, remains a computationally challenging problem. Locality-sensitive hashing (LSH) is one method used to estimate the likelihood of two sequences to have a proper alignment. Using an LSH, it is possible to separate, with high probability and relatively low computation, the pairs of sequences that do not have high-quality alignment from those that may. Therefore, an LSH reduces the overall computational requirement while not introducing many false negatives (i.e. omitting to report a valid alignment). However, current LSH methods treat sequences as a bag of k-mers and do not take into account the relative ordering of k-mers in sequences. In addition, due to the lack of a practical LSH method for edit distance, in practice, LSH methods for Jaccard similarity or Hamming similarity are used as a proxy. RESULTS: We present an LSH method, called Order Min Hash (OMH), for the edit distance. This method is a refinement of the minHash LSH used to approximate the Jaccard similarity, in that OMH is sensitive not only to the k-mer contents of the sequences but also to the relative order of the k-mers in the sequences. We present theoretical guarantees of the OMH as a gapped LSH. AVAILABILITY AND IMPLEMENTATION: The code to generate the results is available at http://github.com/Kingsford-Group/omhismb2019. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
format Online
Article
Text
id pubmed-6612865
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-66128652019-07-12 Locality-sensitive hashing for the edit distance Marçais, Guillaume DeBlasio, Dan Pandey, Prashant Kingsford, Carl Bioinformatics Ismb/Eccb 2019 Conference Proceedings MOTIVATION: Sequence alignment is a central operation in bioinformatics pipeline and, despite many improvements, remains a computationally challenging problem. Locality-sensitive hashing (LSH) is one method used to estimate the likelihood of two sequences to have a proper alignment. Using an LSH, it is possible to separate, with high probability and relatively low computation, the pairs of sequences that do not have high-quality alignment from those that may. Therefore, an LSH reduces the overall computational requirement while not introducing many false negatives (i.e. omitting to report a valid alignment). However, current LSH methods treat sequences as a bag of k-mers and do not take into account the relative ordering of k-mers in sequences. In addition, due to the lack of a practical LSH method for edit distance, in practice, LSH methods for Jaccard similarity or Hamming similarity are used as a proxy. RESULTS: We present an LSH method, called Order Min Hash (OMH), for the edit distance. This method is a refinement of the minHash LSH used to approximate the Jaccard similarity, in that OMH is sensitive not only to the k-mer contents of the sequences but also to the relative order of the k-mers in the sequences. We present theoretical guarantees of the OMH as a gapped LSH. AVAILABILITY AND IMPLEMENTATION: The code to generate the results is available at http://github.com/Kingsford-Group/omhismb2019. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online. Oxford University Press 2019-07 2019-07-05 /pmc/articles/PMC6612865/ /pubmed/31510667 http://dx.doi.org/10.1093/bioinformatics/btz354 Text en © The Author(s) 2019. Published by Oxford University Press. http://creativecommons.org/licenses/by-nc/4.0/ This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact journals.permissions@oup.com
spellingShingle Ismb/Eccb 2019 Conference Proceedings
Marçais, Guillaume
DeBlasio, Dan
Pandey, Prashant
Kingsford, Carl
Locality-sensitive hashing for the edit distance
title Locality-sensitive hashing for the edit distance
title_full Locality-sensitive hashing for the edit distance
title_fullStr Locality-sensitive hashing for the edit distance
title_full_unstemmed Locality-sensitive hashing for the edit distance
title_short Locality-sensitive hashing for the edit distance
title_sort locality-sensitive hashing for the edit distance
topic Ismb/Eccb 2019 Conference Proceedings
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6612865/
https://www.ncbi.nlm.nih.gov/pubmed/31510667
http://dx.doi.org/10.1093/bioinformatics/btz354
work_keys_str_mv AT marcaisguillaume localitysensitivehashingfortheeditdistance
AT deblasiodan localitysensitivehashingfortheeditdistance
AT pandeyprashant localitysensitivehashingfortheeditdistance
AT kingsfordcarl localitysensitivehashingfortheeditdistance