Cargando…
Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost?
The contribution of this paper is to identify and describe current best practices for using Amazon Web Services (AWS) to execute neuroimaging workflows “in the cloud.” Neuroimaging offers a vast set of techniques by which to interrogate the structure and function of the living brain. However, many o...
Autores principales: | , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5675877/ https://www.ncbi.nlm.nih.gov/pubmed/29163119 http://dx.doi.org/10.3389/fninf.2017.00063 |
_version_ | 1783276977750278144 |
---|---|
author | Madhyastha, Tara M. Koh, Natalie Day, Trevor K. M. Hernández-Fernández, Moises Kelley, Austin Peterson, Daniel J. Rajan, Sabreena Woelfer, Karl A. Wolf, Jonathan Grabowski, Thomas J. |
author_facet | Madhyastha, Tara M. Koh, Natalie Day, Trevor K. M. Hernández-Fernández, Moises Kelley, Austin Peterson, Daniel J. Rajan, Sabreena Woelfer, Karl A. Wolf, Jonathan Grabowski, Thomas J. |
author_sort | Madhyastha, Tara M. |
collection | PubMed |
description | The contribution of this paper is to identify and describe current best practices for using Amazon Web Services (AWS) to execute neuroimaging workflows “in the cloud.” Neuroimaging offers a vast set of techniques by which to interrogate the structure and function of the living brain. However, many of the scientists for whom neuroimaging is an extremely important tool have limited training in parallel computation. At the same time, the field is experiencing a surge in computational demands, driven by a combination of data-sharing efforts, improvements in scanner technology that allow acquisition of images with higher image resolution, and by the desire to use statistical techniques that stress processing requirements. Most neuroimaging workflows can be executed as independent parallel jobs and are therefore excellent candidates for running on AWS, but the overhead of learning to do so and determining whether it is worth the cost can be prohibitive. In this paper we describe how to identify neuroimaging workloads that are appropriate for running on AWS, how to benchmark execution time, and how to estimate cost of running on AWS. By benchmarking common neuroimaging applications, we show that cloud computing can be a viable alternative to on-premises hardware. We present guidelines that neuroimaging labs can use to provide a cluster-on-demand type of service that should be familiar to users, and scripts to estimate cost and create such a cluster. |
format | Online Article Text |
id | pubmed-5675877 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-56758772017-11-21 Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost? Madhyastha, Tara M. Koh, Natalie Day, Trevor K. M. Hernández-Fernández, Moises Kelley, Austin Peterson, Daniel J. Rajan, Sabreena Woelfer, Karl A. Wolf, Jonathan Grabowski, Thomas J. Front Neuroinform Neuroscience The contribution of this paper is to identify and describe current best practices for using Amazon Web Services (AWS) to execute neuroimaging workflows “in the cloud.” Neuroimaging offers a vast set of techniques by which to interrogate the structure and function of the living brain. However, many of the scientists for whom neuroimaging is an extremely important tool have limited training in parallel computation. At the same time, the field is experiencing a surge in computational demands, driven by a combination of data-sharing efforts, improvements in scanner technology that allow acquisition of images with higher image resolution, and by the desire to use statistical techniques that stress processing requirements. Most neuroimaging workflows can be executed as independent parallel jobs and are therefore excellent candidates for running on AWS, but the overhead of learning to do so and determining whether it is worth the cost can be prohibitive. In this paper we describe how to identify neuroimaging workloads that are appropriate for running on AWS, how to benchmark execution time, and how to estimate cost of running on AWS. By benchmarking common neuroimaging applications, we show that cloud computing can be a viable alternative to on-premises hardware. We present guidelines that neuroimaging labs can use to provide a cluster-on-demand type of service that should be familiar to users, and scripts to estimate cost and create such a cluster. Frontiers Media S.A. 2017-11-03 /pmc/articles/PMC5675877/ /pubmed/29163119 http://dx.doi.org/10.3389/fninf.2017.00063 Text en Copyright © 2017 Madhyastha, Koh, Day, Hernández-Fernández, Kelley, Peterson, Rajan, Woelfer, Wolf and Grabowski. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Madhyastha, Tara M. Koh, Natalie Day, Trevor K. M. Hernández-Fernández, Moises Kelley, Austin Peterson, Daniel J. Rajan, Sabreena Woelfer, Karl A. Wolf, Jonathan Grabowski, Thomas J. Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost? |
title | Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost? |
title_full | Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost? |
title_fullStr | Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost? |
title_full_unstemmed | Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost? |
title_short | Running Neuroimaging Applications on Amazon Web Services: How, When, and at What Cost? |
title_sort | running neuroimaging applications on amazon web services: how, when, and at what cost? |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5675877/ https://www.ncbi.nlm.nih.gov/pubmed/29163119 http://dx.doi.org/10.3389/fninf.2017.00063 |
work_keys_str_mv | AT madhyasthataram runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost AT kohnatalie runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost AT daytrevorkm runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost AT hernandezfernandezmoises runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost AT kelleyaustin runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost AT petersondanielj runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost AT rajansabreena runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost AT woelferkarla runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost AT wolfjonathan runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost AT grabowskithomasj runningneuroimagingapplicationsonamazonwebserviceshowwhenandatwhatcost |