Cargando…

SPIM workflow manager for HPC

SUMMARY: Here we introduce a Fiji plugin utilizing the HPC-as-a-Service concept, significantly mitigating the challenges life scientists face when delegating complex data-intensive processing workflows to HPC clusters. We demonstrate on a common Selective Plane Illumination Microscopy image processi...

Descripción completa

Detalles Bibliográficos
Autores principales: Kožusznik, Jan, Bainar, Petr, Klímová, Jana, Krumnikl, Michal, Moravec, Pavel, Svatoň, Václav, Tomančák, Pavel
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6761944/
https://www.ncbi.nlm.nih.gov/pubmed/30799494
http://dx.doi.org/10.1093/bioinformatics/btz140
_version_ 1783454129000022016
author Kožusznik, Jan
Bainar, Petr
Klímová, Jana
Krumnikl, Michal
Moravec, Pavel
Svatoň, Václav
Tomančák, Pavel
author_facet Kožusznik, Jan
Bainar, Petr
Klímová, Jana
Krumnikl, Michal
Moravec, Pavel
Svatoň, Václav
Tomančák, Pavel
author_sort Kožusznik, Jan
collection PubMed
description SUMMARY: Here we introduce a Fiji plugin utilizing the HPC-as-a-Service concept, significantly mitigating the challenges life scientists face when delegating complex data-intensive processing workflows to HPC clusters. We demonstrate on a common Selective Plane Illumination Microscopy image processing task that execution of a Fiji workflow on a remote supercomputer leads to improved turnaround time despite the data transfer overhead. The plugin allows the end users to conveniently transfer image data to remote HPC resources, manage pipeline jobs and visualize processed results directly from the Fiji graphical user interface. AVAILABILITY AND IMPLEMENTATION: The code is distributed free and open source under the MIT license. Source code: https://github.com/fiji-hpc/hpc-workflow-manager/, documentation: https://imagej.net/SPIM_Workflow_Manager_For_HPC. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
format Online
Article
Text
id pubmed-6761944
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-67619442019-10-02 SPIM workflow manager for HPC Kožusznik, Jan Bainar, Petr Klímová, Jana Krumnikl, Michal Moravec, Pavel Svatoň, Václav Tomančák, Pavel Bioinformatics Applications Notes SUMMARY: Here we introduce a Fiji plugin utilizing the HPC-as-a-Service concept, significantly mitigating the challenges life scientists face when delegating complex data-intensive processing workflows to HPC clusters. We demonstrate on a common Selective Plane Illumination Microscopy image processing task that execution of a Fiji workflow on a remote supercomputer leads to improved turnaround time despite the data transfer overhead. The plugin allows the end users to conveniently transfer image data to remote HPC resources, manage pipeline jobs and visualize processed results directly from the Fiji graphical user interface. AVAILABILITY AND IMPLEMENTATION: The code is distributed free and open source under the MIT license. Source code: https://github.com/fiji-hpc/hpc-workflow-manager/, documentation: https://imagej.net/SPIM_Workflow_Manager_For_HPC. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online. Oxford University Press 2019-10-01 2019-02-25 /pmc/articles/PMC6761944/ /pubmed/30799494 http://dx.doi.org/10.1093/bioinformatics/btz140 Text en © The Author(s) 2019. Published by Oxford University Press. http://creativecommons.org/licenses/by/4.0/ This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Applications Notes
Kožusznik, Jan
Bainar, Petr
Klímová, Jana
Krumnikl, Michal
Moravec, Pavel
Svatoň, Václav
Tomančák, Pavel
SPIM workflow manager for HPC
title SPIM workflow manager for HPC
title_full SPIM workflow manager for HPC
title_fullStr SPIM workflow manager for HPC
title_full_unstemmed SPIM workflow manager for HPC
title_short SPIM workflow manager for HPC
title_sort spim workflow manager for hpc
topic Applications Notes
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6761944/
https://www.ncbi.nlm.nih.gov/pubmed/30799494
http://dx.doi.org/10.1093/bioinformatics/btz140
work_keys_str_mv AT kozusznikjan spimworkflowmanagerforhpc
AT bainarpetr spimworkflowmanagerforhpc
AT klimovajana spimworkflowmanagerforhpc
AT krumniklmichal spimworkflowmanagerforhpc
AT moravecpavel spimworkflowmanagerforhpc
AT svatonvaclav spimworkflowmanagerforhpc
AT tomancakpavel spimworkflowmanagerforhpc