Cargando…
Transformer-based tool recommendation system in Galaxy
BACKGROUND: Galaxy is a web-based open-source platform for scientific analyses. Researchers use thousands of high-quality tools and workflows for their respective analyses in Galaxy. Tool recommender system predicts a collection of tools that can be used to extend an analysis. In this work, a tool r...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10680333/ https://www.ncbi.nlm.nih.gov/pubmed/38012574 http://dx.doi.org/10.1186/s12859-023-05573-w |
_version_ | 1785150704745185280 |
---|---|
author | Kumar, Anup Grüning, Björn Backofen, Rolf |
author_facet | Kumar, Anup Grüning, Björn Backofen, Rolf |
author_sort | Kumar, Anup |
collection | PubMed |
description | BACKGROUND: Galaxy is a web-based open-source platform for scientific analyses. Researchers use thousands of high-quality tools and workflows for their respective analyses in Galaxy. Tool recommender system predicts a collection of tools that can be used to extend an analysis. In this work, a tool recommender system is developed by training a transformer on workflows available on Galaxy Europe and its performance is compared to other neural networks such as recurrent, convolutional and dense neural networks. RESULTS: The transformer neural network achieves two times faster convergence, has significantly lower model usage (model reconstruction and prediction) time and shows a better generalisation that goes beyond training workflows than the older tool recommender system created using RNN in Galaxy. In addition, the transformer also outperforms CNN and DNN on several key indicators. It achieves a faster convergence time, lower model usage time, and higher quality tool recommendations than CNN. Compared to DNN, it converges faster to a higher precision@k metric (approximately 0.98 by transformer compared to approximately 0.9 by DNN) and shows higher quality tool recommendations. CONCLUSION: Our work shows a novel usage of transformers to recommend tools for extending scientific workflows. A more robust tool recommendation model, created using a transformer, having significantly lower usage time than RNN and CNN, higher precision@k than DNN, and higher quality tool recommendations than all three neural networks, will benefit researchers in creating scientifically significant workflows and exploratory data analysis in Galaxy. Additionally, the ability to train faster than all three neural networks imparts more scalability for training on larger datasets consisting of millions of tool sequences. Open-source scripts to create the recommendation model are available under MIT licence at https://github.com/anuprulez/galaxy_tool_recommendation_transformers SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12859-023-05573-w. |
format | Online Article Text |
id | pubmed-10680333 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-106803332023-11-27 Transformer-based tool recommendation system in Galaxy Kumar, Anup Grüning, Björn Backofen, Rolf BMC Bioinformatics Software BACKGROUND: Galaxy is a web-based open-source platform for scientific analyses. Researchers use thousands of high-quality tools and workflows for their respective analyses in Galaxy. Tool recommender system predicts a collection of tools that can be used to extend an analysis. In this work, a tool recommender system is developed by training a transformer on workflows available on Galaxy Europe and its performance is compared to other neural networks such as recurrent, convolutional and dense neural networks. RESULTS: The transformer neural network achieves two times faster convergence, has significantly lower model usage (model reconstruction and prediction) time and shows a better generalisation that goes beyond training workflows than the older tool recommender system created using RNN in Galaxy. In addition, the transformer also outperforms CNN and DNN on several key indicators. It achieves a faster convergence time, lower model usage time, and higher quality tool recommendations than CNN. Compared to DNN, it converges faster to a higher precision@k metric (approximately 0.98 by transformer compared to approximately 0.9 by DNN) and shows higher quality tool recommendations. CONCLUSION: Our work shows a novel usage of transformers to recommend tools for extending scientific workflows. A more robust tool recommendation model, created using a transformer, having significantly lower usage time than RNN and CNN, higher precision@k than DNN, and higher quality tool recommendations than all three neural networks, will benefit researchers in creating scientifically significant workflows and exploratory data analysis in Galaxy. Additionally, the ability to train faster than all three neural networks imparts more scalability for training on larger datasets consisting of millions of tool sequences. Open-source scripts to create the recommendation model are available under MIT licence at https://github.com/anuprulez/galaxy_tool_recommendation_transformers SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12859-023-05573-w. BioMed Central 2023-11-27 /pmc/articles/PMC10680333/ /pubmed/38012574 http://dx.doi.org/10.1186/s12859-023-05573-w Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Software Kumar, Anup Grüning, Björn Backofen, Rolf Transformer-based tool recommendation system in Galaxy |
title | Transformer-based tool recommendation system in Galaxy |
title_full | Transformer-based tool recommendation system in Galaxy |
title_fullStr | Transformer-based tool recommendation system in Galaxy |
title_full_unstemmed | Transformer-based tool recommendation system in Galaxy |
title_short | Transformer-based tool recommendation system in Galaxy |
title_sort | transformer-based tool recommendation system in galaxy |
topic | Software |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10680333/ https://www.ncbi.nlm.nih.gov/pubmed/38012574 http://dx.doi.org/10.1186/s12859-023-05573-w |
work_keys_str_mv | AT kumaranup transformerbasedtoolrecommendationsystemingalaxy AT gruningbjorn transformerbasedtoolrecommendationsystemingalaxy AT backofenrolf transformerbasedtoolrecommendationsystemingalaxy |