Cargando…
Opportunities for Cost Savings with In-Transit Visualization
We analyze the opportunities for in-transit visualization to provide cost savings compared to in-line visualization. We begin by developing a cost model that includes factors related to both in-line and in-transit which allows comparisons to be made between the two methods. We then run a series of s...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7295346/ http://dx.doi.org/10.1007/978-3-030-50743-5_8 |
_version_ | 1783546633112256512 |
---|---|
author | Kress, James Larsen, Matthew Choi, Jong Kim, Mark Wolf, Matthew Podhorszki, Norbert Klasky, Scott Childs, Hank Pugmire, David |
author_facet | Kress, James Larsen, Matthew Choi, Jong Kim, Mark Wolf, Matthew Podhorszki, Norbert Klasky, Scott Childs, Hank Pugmire, David |
author_sort | Kress, James |
collection | PubMed |
description | We analyze the opportunities for in-transit visualization to provide cost savings compared to in-line visualization. We begin by developing a cost model that includes factors related to both in-line and in-transit which allows comparisons to be made between the two methods. We then run a series of studies to create a corpus of data for our model. We run two different visualization algorithms, one that is computation heavy and one that is communication heavy with concurrencies up to 32, 768 cores. Our primary results are in exploring the cost model within the context of our corpus. Our findings show that in-transit consistently achieves significant cost efficiencies by running visualization algorithms at lower concurrency, and that in many cases these efficiencies are enough to offset other costs (transfer, blocking, and additional nodes) to be cost effective overall. Finally, this work informs future studies, which can focus on choosing ideal configurations for in-transit processing that can consistently achieve cost efficiencies. |
format | Online Article Text |
id | pubmed-7295346 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
record_format | MEDLINE/PubMed |
spelling | pubmed-72953462020-06-16 Opportunities for Cost Savings with In-Transit Visualization Kress, James Larsen, Matthew Choi, Jong Kim, Mark Wolf, Matthew Podhorszki, Norbert Klasky, Scott Childs, Hank Pugmire, David High Performance Computing Article We analyze the opportunities for in-transit visualization to provide cost savings compared to in-line visualization. We begin by developing a cost model that includes factors related to both in-line and in-transit which allows comparisons to be made between the two methods. We then run a series of studies to create a corpus of data for our model. We run two different visualization algorithms, one that is computation heavy and one that is communication heavy with concurrencies up to 32, 768 cores. Our primary results are in exploring the cost model within the context of our corpus. Our findings show that in-transit consistently achieves significant cost efficiencies by running visualization algorithms at lower concurrency, and that in many cases these efficiencies are enough to offset other costs (transfer, blocking, and additional nodes) to be cost effective overall. Finally, this work informs future studies, which can focus on choosing ideal configurations for in-transit processing that can consistently achieve cost efficiencies. 2020-05-22 /pmc/articles/PMC7295346/ http://dx.doi.org/10.1007/978-3-030-50743-5_8 Text en © Springer Nature Switzerland AG 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Article Kress, James Larsen, Matthew Choi, Jong Kim, Mark Wolf, Matthew Podhorszki, Norbert Klasky, Scott Childs, Hank Pugmire, David Opportunities for Cost Savings with In-Transit Visualization |
title | Opportunities for Cost Savings with In-Transit Visualization |
title_full | Opportunities for Cost Savings with In-Transit Visualization |
title_fullStr | Opportunities for Cost Savings with In-Transit Visualization |
title_full_unstemmed | Opportunities for Cost Savings with In-Transit Visualization |
title_short | Opportunities for Cost Savings with In-Transit Visualization |
title_sort | opportunities for cost savings with in-transit visualization |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7295346/ http://dx.doi.org/10.1007/978-3-030-50743-5_8 |
work_keys_str_mv | AT kressjames opportunitiesforcostsavingswithintransitvisualization AT larsenmatthew opportunitiesforcostsavingswithintransitvisualization AT choijong opportunitiesforcostsavingswithintransitvisualization AT kimmark opportunitiesforcostsavingswithintransitvisualization AT wolfmatthew opportunitiesforcostsavingswithintransitvisualization AT podhorszkinorbert opportunitiesforcostsavingswithintransitvisualization AT klaskyscott opportunitiesforcostsavingswithintransitvisualization AT childshank opportunitiesforcostsavingswithintransitvisualization AT pugmiredavid opportunitiesforcostsavingswithintransitvisualization |