Cargando…

Cloud-enabled Biodepot workflow builder integrates image processing using Fiji with reproducible data analysis using Jupyter notebooks

Modern biomedical image analyses workflows contain multiple computational processing tasks giving rise to problems in reproducibility. In addition, image datasets can span both spatial and temporal dimensions, with additional channels for fluorescence and other data, resulting in datasets that are t...

Descripción completa

Detalles Bibliográficos
Autores principales: Hung, Ling-Hong, Straw, Evan, Reddy, Shishir, Schmitz, Robert, Colburn, Zachary, Yeung, Ka Yee
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9440253/
https://www.ncbi.nlm.nih.gov/pubmed/36056115
http://dx.doi.org/10.1038/s41598-022-19173-w
_version_ 1784782299557003264
author Hung, Ling-Hong
Straw, Evan
Reddy, Shishir
Schmitz, Robert
Colburn, Zachary
Yeung, Ka Yee
author_facet Hung, Ling-Hong
Straw, Evan
Reddy, Shishir
Schmitz, Robert
Colburn, Zachary
Yeung, Ka Yee
author_sort Hung, Ling-Hong
collection PubMed
description Modern biomedical image analyses workflows contain multiple computational processing tasks giving rise to problems in reproducibility. In addition, image datasets can span both spatial and temporal dimensions, with additional channels for fluorescence and other data, resulting in datasets that are too large to be processed locally on a laptop. For omics analyses, software containers have been shown to enhance reproducibility, facilitate installation and provide access to scalable computational resources on the cloud. However, most image analyses contain steps that are graphical and interactive, features that are not supported by most omics execution engines. We present the containerized and cloud-enabled Biodepot-workflow-builder platform that supports graphics from software containers and has been extended for image analyses. We demonstrate the potential of our modular approach with multi-step workflows that incorporate the popular and open-source Fiji suite for image processing. One of our examples integrates fully interactive ImageJ macros with Jupyter notebooks. Our second example illustrates how the complicated cloud setup of an computationally intensive process such as stitching 3D digital pathology datasets using BigStitcher can be automated and simplified. In both examples, users can leverage a form-based graphical interface to execute multi-step workflows with a single click, using the provided sample data and preset input parameters. Alternatively, users can interactively modify the image processing steps in the workflow, apply the workflows to their own data, change the input parameters and macros. By providing interactive graphics support to software containers, our modular platform supports reproducible image analysis workflows, simplified access to cloud resources for analysis of large datasets, and integration across different applications such as Jupyter.
format Online
Article
Text
id pubmed-9440253
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-94402532022-09-04 Cloud-enabled Biodepot workflow builder integrates image processing using Fiji with reproducible data analysis using Jupyter notebooks Hung, Ling-Hong Straw, Evan Reddy, Shishir Schmitz, Robert Colburn, Zachary Yeung, Ka Yee Sci Rep Article Modern biomedical image analyses workflows contain multiple computational processing tasks giving rise to problems in reproducibility. In addition, image datasets can span both spatial and temporal dimensions, with additional channels for fluorescence and other data, resulting in datasets that are too large to be processed locally on a laptop. For omics analyses, software containers have been shown to enhance reproducibility, facilitate installation and provide access to scalable computational resources on the cloud. However, most image analyses contain steps that are graphical and interactive, features that are not supported by most omics execution engines. We present the containerized and cloud-enabled Biodepot-workflow-builder platform that supports graphics from software containers and has been extended for image analyses. We demonstrate the potential of our modular approach with multi-step workflows that incorporate the popular and open-source Fiji suite for image processing. One of our examples integrates fully interactive ImageJ macros with Jupyter notebooks. Our second example illustrates how the complicated cloud setup of an computationally intensive process such as stitching 3D digital pathology datasets using BigStitcher can be automated and simplified. In both examples, users can leverage a form-based graphical interface to execute multi-step workflows with a single click, using the provided sample data and preset input parameters. Alternatively, users can interactively modify the image processing steps in the workflow, apply the workflows to their own data, change the input parameters and macros. By providing interactive graphics support to software containers, our modular platform supports reproducible image analysis workflows, simplified access to cloud resources for analysis of large datasets, and integration across different applications such as Jupyter. Nature Publishing Group UK 2022-09-02 /pmc/articles/PMC9440253/ /pubmed/36056115 http://dx.doi.org/10.1038/s41598-022-19173-w Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Hung, Ling-Hong
Straw, Evan
Reddy, Shishir
Schmitz, Robert
Colburn, Zachary
Yeung, Ka Yee
Cloud-enabled Biodepot workflow builder integrates image processing using Fiji with reproducible data analysis using Jupyter notebooks
title Cloud-enabled Biodepot workflow builder integrates image processing using Fiji with reproducible data analysis using Jupyter notebooks
title_full Cloud-enabled Biodepot workflow builder integrates image processing using Fiji with reproducible data analysis using Jupyter notebooks
title_fullStr Cloud-enabled Biodepot workflow builder integrates image processing using Fiji with reproducible data analysis using Jupyter notebooks
title_full_unstemmed Cloud-enabled Biodepot workflow builder integrates image processing using Fiji with reproducible data analysis using Jupyter notebooks
title_short Cloud-enabled Biodepot workflow builder integrates image processing using Fiji with reproducible data analysis using Jupyter notebooks
title_sort cloud-enabled biodepot workflow builder integrates image processing using fiji with reproducible data analysis using jupyter notebooks
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9440253/
https://www.ncbi.nlm.nih.gov/pubmed/36056115
http://dx.doi.org/10.1038/s41598-022-19173-w
work_keys_str_mv AT hunglinghong cloudenabledbiodepotworkflowbuilderintegratesimageprocessingusingfijiwithreproducibledataanalysisusingjupyternotebooks
AT strawevan cloudenabledbiodepotworkflowbuilderintegratesimageprocessingusingfijiwithreproducibledataanalysisusingjupyternotebooks
AT reddyshishir cloudenabledbiodepotworkflowbuilderintegratesimageprocessingusingfijiwithreproducibledataanalysisusingjupyternotebooks
AT schmitzrobert cloudenabledbiodepotworkflowbuilderintegratesimageprocessingusingfijiwithreproducibledataanalysisusingjupyternotebooks
AT colburnzachary cloudenabledbiodepotworkflowbuilderintegratesimageprocessingusingfijiwithreproducibledataanalysisusingjupyternotebooks
AT yeungkayee cloudenabledbiodepotworkflowbuilderintegratesimageprocessingusingfijiwithreproducibledataanalysisusingjupyternotebooks