Cargando…

Transformer-based tool recommendation system in Galaxy

BACKGROUND: Galaxy is a web-based open-source platform for scientific analyses. Researchers use thousands of high-quality tools and workflows for their respective analyses in Galaxy. Tool recommender system predicts a collection of tools that can be used to extend an analysis. In this work, a tool r...

Descripción completa

Detalles Bibliográficos
Autores principales: Kumar, Anup, Grüning, Björn, Backofen, Rolf
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10680333/
https://www.ncbi.nlm.nih.gov/pubmed/38012574
http://dx.doi.org/10.1186/s12859-023-05573-w
_version_ 1785150704745185280
author Kumar, Anup
Grüning, Björn
Backofen, Rolf
author_facet Kumar, Anup
Grüning, Björn
Backofen, Rolf
author_sort Kumar, Anup
collection PubMed
description BACKGROUND: Galaxy is a web-based open-source platform for scientific analyses. Researchers use thousands of high-quality tools and workflows for their respective analyses in Galaxy. Tool recommender system predicts a collection of tools that can be used to extend an analysis. In this work, a tool recommender system is developed by training a transformer on workflows available on Galaxy Europe and its performance is compared to other neural networks such as recurrent, convolutional and dense neural networks. RESULTS: The transformer neural network achieves two times faster convergence, has significantly lower model usage (model reconstruction and prediction) time and shows a better generalisation that goes beyond training workflows than the older tool recommender system created using RNN in Galaxy. In addition, the transformer also outperforms CNN and DNN on several key indicators. It achieves a faster convergence time, lower model usage time, and higher quality tool recommendations than CNN. Compared to DNN, it converges faster to a higher precision@k metric (approximately 0.98 by transformer compared to approximately 0.9 by DNN) and shows higher quality tool recommendations. CONCLUSION: Our work shows a novel usage of transformers to recommend tools for extending scientific workflows. A more robust tool recommendation model, created using a transformer, having significantly lower usage time than RNN and CNN, higher precision@k than DNN, and higher quality tool recommendations than all three neural networks, will benefit researchers in creating scientifically significant workflows and exploratory data analysis in Galaxy. Additionally, the ability to train faster than all three neural networks imparts more scalability for training on larger datasets consisting of millions of tool sequences. Open-source scripts to create the recommendation model are available under MIT licence at https://github.com/anuprulez/galaxy_tool_recommendation_transformers SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12859-023-05573-w.
format Online
Article
Text
id pubmed-10680333
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-106803332023-11-27 Transformer-based tool recommendation system in Galaxy Kumar, Anup Grüning, Björn Backofen, Rolf BMC Bioinformatics Software BACKGROUND: Galaxy is a web-based open-source platform for scientific analyses. Researchers use thousands of high-quality tools and workflows for their respective analyses in Galaxy. Tool recommender system predicts a collection of tools that can be used to extend an analysis. In this work, a tool recommender system is developed by training a transformer on workflows available on Galaxy Europe and its performance is compared to other neural networks such as recurrent, convolutional and dense neural networks. RESULTS: The transformer neural network achieves two times faster convergence, has significantly lower model usage (model reconstruction and prediction) time and shows a better generalisation that goes beyond training workflows than the older tool recommender system created using RNN in Galaxy. In addition, the transformer also outperforms CNN and DNN on several key indicators. It achieves a faster convergence time, lower model usage time, and higher quality tool recommendations than CNN. Compared to DNN, it converges faster to a higher precision@k metric (approximately 0.98 by transformer compared to approximately 0.9 by DNN) and shows higher quality tool recommendations. CONCLUSION: Our work shows a novel usage of transformers to recommend tools for extending scientific workflows. A more robust tool recommendation model, created using a transformer, having significantly lower usage time than RNN and CNN, higher precision@k than DNN, and higher quality tool recommendations than all three neural networks, will benefit researchers in creating scientifically significant workflows and exploratory data analysis in Galaxy. Additionally, the ability to train faster than all three neural networks imparts more scalability for training on larger datasets consisting of millions of tool sequences. Open-source scripts to create the recommendation model are available under MIT licence at https://github.com/anuprulez/galaxy_tool_recommendation_transformers SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12859-023-05573-w. BioMed Central 2023-11-27 /pmc/articles/PMC10680333/ /pubmed/38012574 http://dx.doi.org/10.1186/s12859-023-05573-w Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Software
Kumar, Anup
Grüning, Björn
Backofen, Rolf
Transformer-based tool recommendation system in Galaxy
title Transformer-based tool recommendation system in Galaxy
title_full Transformer-based tool recommendation system in Galaxy
title_fullStr Transformer-based tool recommendation system in Galaxy
title_full_unstemmed Transformer-based tool recommendation system in Galaxy
title_short Transformer-based tool recommendation system in Galaxy
title_sort transformer-based tool recommendation system in galaxy
topic Software
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10680333/
https://www.ncbi.nlm.nih.gov/pubmed/38012574
http://dx.doi.org/10.1186/s12859-023-05573-w
work_keys_str_mv AT kumaranup transformerbasedtoolrecommendationsystemingalaxy
AT gruningbjorn transformerbasedtoolrecommendationsystemingalaxy
AT backofenrolf transformerbasedtoolrecommendationsystemingalaxy