Cargando…

Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review

SIMPLE SUMMARY: The rapidly advancing field of deep learning, specifically transformer-based architectures and attention mechanisms, has found substantial applicability in bioinformatics and genome data analysis. Given the analogous nature of genome sequences to language texts, these techniques init...

Descripción completa

Detalles Bibliográficos
Autores principales: Choi, Sanghyuk Roy, Lee, Minhyeok
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10376273/
https://www.ncbi.nlm.nih.gov/pubmed/37508462
http://dx.doi.org/10.3390/biology12071033
_version_ 1785079230059511808
author Choi, Sanghyuk Roy
Lee, Minhyeok
author_facet Choi, Sanghyuk Roy
Lee, Minhyeok
author_sort Choi, Sanghyuk Roy
collection PubMed
description SIMPLE SUMMARY: The rapidly advancing field of deep learning, specifically transformer-based architectures and attention mechanisms, has found substantial applicability in bioinformatics and genome data analysis. Given the analogous nature of genome sequences to language texts, these techniques initially successful in natural language processing have been applied to genomic data. This review provides an in-depth analysis of the most recent advancements and applications of these techniques to genome data, critically evaluating their advantages and limitations. By investigating studies from 2019 to 2023, this review identifies potential future research areas, thereby encouraging further advancements in the field. ABSTRACT: The emergence and rapid development of deep learning, specifically transformer-based architectures and attention mechanisms, have had transformative implications across several domains, including bioinformatics and genome data analysis. The analogous nature of genome sequences to language texts has enabled the application of techniques that have exhibited success in fields ranging from natural language processing to genomic data. This review provides a comprehensive analysis of the most recent advancements in the application of transformer architectures and attention mechanisms to genome and transcriptome data. The focus of this review is on the critical evaluation of these techniques, discussing their advantages and limitations in the context of genome data analysis. With the swift pace of development in deep learning methodologies, it becomes vital to continually assess and reflect on the current standing and future direction of the research. Therefore, this review aims to serve as a timely resource for both seasoned researchers and newcomers, offering a panoramic view of the recent advancements and elucidating the state-of-the-art applications in the field. Furthermore, this review paper serves to highlight potential areas of future investigation by critically evaluating studies from 2019 to 2023, thereby acting as a stepping-stone for further research endeavors.
format Online
Article
Text
id pubmed-10376273
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-103762732023-07-29 Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review Choi, Sanghyuk Roy Lee, Minhyeok Biology (Basel) Review SIMPLE SUMMARY: The rapidly advancing field of deep learning, specifically transformer-based architectures and attention mechanisms, has found substantial applicability in bioinformatics and genome data analysis. Given the analogous nature of genome sequences to language texts, these techniques initially successful in natural language processing have been applied to genomic data. This review provides an in-depth analysis of the most recent advancements and applications of these techniques to genome data, critically evaluating their advantages and limitations. By investigating studies from 2019 to 2023, this review identifies potential future research areas, thereby encouraging further advancements in the field. ABSTRACT: The emergence and rapid development of deep learning, specifically transformer-based architectures and attention mechanisms, have had transformative implications across several domains, including bioinformatics and genome data analysis. The analogous nature of genome sequences to language texts has enabled the application of techniques that have exhibited success in fields ranging from natural language processing to genomic data. This review provides a comprehensive analysis of the most recent advancements in the application of transformer architectures and attention mechanisms to genome and transcriptome data. The focus of this review is on the critical evaluation of these techniques, discussing their advantages and limitations in the context of genome data analysis. With the swift pace of development in deep learning methodologies, it becomes vital to continually assess and reflect on the current standing and future direction of the research. Therefore, this review aims to serve as a timely resource for both seasoned researchers and newcomers, offering a panoramic view of the recent advancements and elucidating the state-of-the-art applications in the field. Furthermore, this review paper serves to highlight potential areas of future investigation by critically evaluating studies from 2019 to 2023, thereby acting as a stepping-stone for further research endeavors. MDPI 2023-07-22 /pmc/articles/PMC10376273/ /pubmed/37508462 http://dx.doi.org/10.3390/biology12071033 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Review
Choi, Sanghyuk Roy
Lee, Minhyeok
Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review
title Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review
title_full Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review
title_fullStr Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review
title_full_unstemmed Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review
title_short Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review
title_sort transformer architecture and attention mechanisms in genome data analysis: a comprehensive review
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10376273/
https://www.ncbi.nlm.nih.gov/pubmed/37508462
http://dx.doi.org/10.3390/biology12071033
work_keys_str_mv AT choisanghyukroy transformerarchitectureandattentionmechanismsingenomedataanalysisacomprehensivereview
AT leeminhyeok transformerarchitectureandattentionmechanismsingenomedataanalysisacomprehensivereview