Cargando…

Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost?

The contribution of this paper is to identify and describe current best practices for using Amazon Web Services (AWS) to execute neuroimaging workflows “in the cloud.” Neuroimaging offers a vast set of techniques by which to interrogate the structure and function of the living brain. However, many o...

Descripción completa

Detalles Bibliográficos
Autores principales: Madhyastha, Tara M., Koh, Natalie, Day, Trevor K. M., Hernández-Fernández, Moises, Kelley, Austin, Peterson, Daniel J., Rajan, Sabreena, Woelfer, Karl A., Wolf, Jonathan, Grabowski, Thomas J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5675877/
https://www.ncbi.nlm.nih.gov/pubmed/29163119
http://dx.doi.org/10.3389/fninf.2017.00063
_version_ 1783276977750278144
author Madhyastha, Tara M.
Koh, Natalie
Day, Trevor K. M.
Hernández-Fernández, Moises
Kelley, Austin
Peterson, Daniel J.
Rajan, Sabreena
Woelfer, Karl A.
Wolf, Jonathan
Grabowski, Thomas J.
author_facet Madhyastha, Tara M.
Koh, Natalie
Day, Trevor K. M.
Hernández-Fernández, Moises
Kelley, Austin
Peterson, Daniel J.
Rajan, Sabreena
Woelfer, Karl A.
Wolf, Jonathan
Grabowski, Thomas J.
author_sort Madhyastha, Tara M.
collection PubMed
description The contribution of this paper is to identify and describe current best practices for using Amazon Web Services (AWS) to execute neuroimaging workflows “in the cloud.” Neuroimaging offers a vast set of techniques by which to interrogate the structure and function of the living brain. However, many of the scientists for whom neuroimaging is an extremely important tool have limited training in parallel computation. At the same time, the field is experiencing a surge in computational demands, driven by a combination of data-sharing efforts, improvements in scanner technology that allow acquisition of images with higher image resolution, and by the desire to use statistical techniques that stress processing requirements. Most neuroimaging workflows can be executed as independent parallel jobs and are therefore excellent candidates for running on AWS, but the overhead of learning to do so and determining whether it is worth the cost can be prohibitive. In this paper we describe how to identify neuroimaging workloads that are appropriate for running on AWS, how to benchmark execution time, and how to estimate cost of running on AWS. By benchmarking common neuroimaging applications, we show that cloud computing can be a viable alternative to on-premises hardware. We present guidelines that neuroimaging labs can use to provide a cluster-on-demand type of service that should be familiar to users, and scripts to estimate cost and create such a cluster.
format Online
Article
Text
id pubmed-5675877
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-56758772017-11-21 Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost? Madhyastha, Tara M. Koh, Natalie Day, Trevor K. M. Hernández-Fernández, Moises Kelley, Austin Peterson, Daniel J. Rajan, Sabreena Woelfer, Karl A. Wolf, Jonathan Grabowski, Thomas J. Front Neuroinform Neuroscience The contribution of this paper is to identify and describe current best practices for using Amazon Web Services (AWS) to execute neuroimaging workflows “in the cloud.” Neuroimaging offers a vast set of techniques by which to interrogate the structure and function of the living brain. However, many of the scientists for whom neuroimaging is an extremely important tool have limited training in parallel computation. At the same time, the field is experiencing a surge in computational demands, driven by a combination of data-sharing efforts, improvements in scanner technology that allow acquisition of images with higher image resolution, and by the desire to use statistical techniques that stress processing requirements. Most neuroimaging workflows can be executed as independent parallel jobs and are therefore excellent candidates for running on AWS, but the overhead of learning to do so and determining whether it is worth the cost can be prohibitive. In this paper we describe how to identify neuroimaging workloads that are appropriate for running on AWS, how to benchmark execution time, and how to estimate cost of running on AWS. By benchmarking common neuroimaging applications, we show that cloud computing can be a viable alternative to on-premises hardware. We present guidelines that neuroimaging labs can use to provide a cluster-on-demand type of service that should be familiar to users, and scripts to estimate cost and create such a cluster. Frontiers Media S.A. 2017-11-03 /pmc/articles/PMC5675877/ /pubmed/29163119 http://dx.doi.org/10.3389/fninf.2017.00063 Text en Copyright © 2017 Madhyastha, Koh, Day, Hernández-Fernández, Kelley, Peterson, Rajan, Woelfer, Wolf and Grabowski. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Madhyastha, Tara M.
Koh, Natalie
Day, Trevor K. M.
Hernández-Fernández, Moises
Kelley, Austin
Peterson, Daniel J.
Rajan, Sabreena
Woelfer, Karl A.
Wolf, Jonathan
Grabowski, Thomas J.
Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost?
title Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost?
title_full Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost?
title_fullStr Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost?
title_full_unstemmed Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost?
title_short Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost?
title_sort running neuroimaging applications on amazon web services: how, when, and at what cost?
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5675877/
https://www.ncbi.nlm.nih.gov/pubmed/29163119
http://dx.doi.org/10.3389/fninf.2017.00063
work_keys_str_mv AT madhyasthataram runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost
AT kohnatalie runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost
AT daytrevorkm runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost
AT hernandezfernandezmoises runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost
AT kelleyaustin runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost
AT petersondanielj runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost
AT rajansabreena runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost
AT woelferkarla runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost
AT wolfjonathan runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost
AT grabowskithomasj runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost