Cargando…

Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment

Some scientific studies involve huge amounts of bioinformatics data that cannot be analyzed on personal computers usually employed by researchers for day-to-day activities but rather necessitate effective computational infrastructures that can work in a distributed way. For this purpose, distributed...

Descripción completa

Detalles Bibliográficos
Autores principales: Chicco, Davide, Ferraro Petrillo, Umberto, Cattaneo, Giuseppe
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10358940/
https://www.ncbi.nlm.nih.gov/pubmed/37471333
http://dx.doi.org/10.1371/journal.pcbi.1011272
_version_ 1785075775059263488
author Chicco, Davide
Ferraro Petrillo, Umberto
Cattaneo, Giuseppe
author_facet Chicco, Davide
Ferraro Petrillo, Umberto
Cattaneo, Giuseppe
author_sort Chicco, Davide
collection PubMed
description Some scientific studies involve huge amounts of bioinformatics data that cannot be analyzed on personal computers usually employed by researchers for day-to-day activities but rather necessitate effective computational infrastructures that can work in a distributed way. For this purpose, distributed computing systems have become useful tools to analyze large amounts of bioinformatics data and to generate relevant results on virtual environments, where software can be executed for hours or even days without affecting the personal computer or laptop of a researcher. Even if distributed computing resources have become pivotal in multiple bioinformatics laboratories, often researchers and students use them in the wrong ways, making mistakes that can cause the distributed computers to underperform or that can even generate wrong outcomes. In this context, we present here ten quick tips for the usage of Apache Spark distributed computing systems for bioinformatics analyses: ten simple guidelines that, if taken into account, can help users avoid common mistakes and can help them run their bioinformatics analyses smoothly. Even if we designed our recommendations for beginners and students, they should be followed by experts too. We think our quick tips can help anyone make use of Apache Spark distributed computing systems more efficiently and ultimately help generate better, more reliable scientific results.
format Online
Article
Text
id pubmed-10358940
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-103589402023-07-21 Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment Chicco, Davide Ferraro Petrillo, Umberto Cattaneo, Giuseppe PLoS Comput Biol Education Some scientific studies involve huge amounts of bioinformatics data that cannot be analyzed on personal computers usually employed by researchers for day-to-day activities but rather necessitate effective computational infrastructures that can work in a distributed way. For this purpose, distributed computing systems have become useful tools to analyze large amounts of bioinformatics data and to generate relevant results on virtual environments, where software can be executed for hours or even days without affecting the personal computer or laptop of a researcher. Even if distributed computing resources have become pivotal in multiple bioinformatics laboratories, often researchers and students use them in the wrong ways, making mistakes that can cause the distributed computers to underperform or that can even generate wrong outcomes. In this context, we present here ten quick tips for the usage of Apache Spark distributed computing systems for bioinformatics analyses: ten simple guidelines that, if taken into account, can help users avoid common mistakes and can help them run their bioinformatics analyses smoothly. Even if we designed our recommendations for beginners and students, they should be followed by experts too. We think our quick tips can help anyone make use of Apache Spark distributed computing systems more efficiently and ultimately help generate better, more reliable scientific results. Public Library of Science 2023-07-20 /pmc/articles/PMC10358940/ /pubmed/37471333 http://dx.doi.org/10.1371/journal.pcbi.1011272 Text en © 2023 Chicco et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Education
Chicco, Davide
Ferraro Petrillo, Umberto
Cattaneo, Giuseppe
Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment
title Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment
title_full Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment
title_fullStr Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment
title_full_unstemmed Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment
title_short Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment
title_sort ten quick tips for bioinformatics analyses using an apache spark distributed computing environment
topic Education
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10358940/
https://www.ncbi.nlm.nih.gov/pubmed/37471333
http://dx.doi.org/10.1371/journal.pcbi.1011272
work_keys_str_mv AT chiccodavide tenquicktipsforbioinformaticsanalysesusinganapachesparkdistributedcomputingenvironment
AT ferraropetrilloumberto tenquicktipsforbioinformaticsanalysesusinganapachesparkdistributedcomputingenvironment
AT cattaneogiuseppe tenquicktipsforbioinformaticsanalysesusinganapachesparkdistributedcomputingenvironment