Cargando…
SPIM workflow manager for HPC
SUMMARY: Here we introduce a Fiji plugin utilizing the HPC-as-a-Service concept, significantly mitigating the challenges life scientists face when delegating complex data-intensive processing workflows to HPC clusters. We demonstrate on a common Selective Plane Illumination Microscopy image processi...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6761944/ https://www.ncbi.nlm.nih.gov/pubmed/30799494 http://dx.doi.org/10.1093/bioinformatics/btz140 |
_version_ | 1783454129000022016 |
---|---|
author | Kožusznik, Jan Bainar, Petr Klímová, Jana Krumnikl, Michal Moravec, Pavel Svatoň, Václav Tomančák, Pavel |
author_facet | Kožusznik, Jan Bainar, Petr Klímová, Jana Krumnikl, Michal Moravec, Pavel Svatoň, Václav Tomančák, Pavel |
author_sort | Kožusznik, Jan |
collection | PubMed |
description | SUMMARY: Here we introduce a Fiji plugin utilizing the HPC-as-a-Service concept, significantly mitigating the challenges life scientists face when delegating complex data-intensive processing workflows to HPC clusters. We demonstrate on a common Selective Plane Illumination Microscopy image processing task that execution of a Fiji workflow on a remote supercomputer leads to improved turnaround time despite the data transfer overhead. The plugin allows the end users to conveniently transfer image data to remote HPC resources, manage pipeline jobs and visualize processed results directly from the Fiji graphical user interface. AVAILABILITY AND IMPLEMENTATION: The code is distributed free and open source under the MIT license. Source code: https://github.com/fiji-hpc/hpc-workflow-manager/, documentation: https://imagej.net/SPIM_Workflow_Manager_For_HPC. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online. |
format | Online Article Text |
id | pubmed-6761944 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-67619442019-10-02 SPIM workflow manager for HPC Kožusznik, Jan Bainar, Petr Klímová, Jana Krumnikl, Michal Moravec, Pavel Svatoň, Václav Tomančák, Pavel Bioinformatics Applications Notes SUMMARY: Here we introduce a Fiji plugin utilizing the HPC-as-a-Service concept, significantly mitigating the challenges life scientists face when delegating complex data-intensive processing workflows to HPC clusters. We demonstrate on a common Selective Plane Illumination Microscopy image processing task that execution of a Fiji workflow on a remote supercomputer leads to improved turnaround time despite the data transfer overhead. The plugin allows the end users to conveniently transfer image data to remote HPC resources, manage pipeline jobs and visualize processed results directly from the Fiji graphical user interface. AVAILABILITY AND IMPLEMENTATION: The code is distributed free and open source under the MIT license. Source code: https://github.com/fiji-hpc/hpc-workflow-manager/, documentation: https://imagej.net/SPIM_Workflow_Manager_For_HPC. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online. Oxford University Press 2019-10-01 2019-02-25 /pmc/articles/PMC6761944/ /pubmed/30799494 http://dx.doi.org/10.1093/bioinformatics/btz140 Text en © The Author(s) 2019. Published by Oxford University Press. http://creativecommons.org/licenses/by/4.0/ This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Applications Notes Kožusznik, Jan Bainar, Petr Klímová, Jana Krumnikl, Michal Moravec, Pavel Svatoň, Václav Tomančák, Pavel SPIM workflow manager for HPC |
title | SPIM workflow manager for HPC |
title_full | SPIM workflow manager for HPC |
title_fullStr | SPIM workflow manager for HPC |
title_full_unstemmed | SPIM workflow manager for HPC |
title_short | SPIM workflow manager for HPC |
title_sort | spim workflow manager for hpc |
topic | Applications Notes |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6761944/ https://www.ncbi.nlm.nih.gov/pubmed/30799494 http://dx.doi.org/10.1093/bioinformatics/btz140 |
work_keys_str_mv | AT kozusznikjan spimworkflowmanagerforhpc AT bainarpetr spimworkflowmanagerforhpc AT klimovajana spimworkflowmanagerforhpc AT krumniklmichal spimworkflowmanagerforhpc AT moravecpavel spimworkflowmanagerforhpc AT svatonvaclav spimworkflowmanagerforhpc AT tomancakpavel spimworkflowmanagerforhpc |