Cargando…

Opportunities for Cost Savings with In-Transit Visualization

We analyze the opportunities for in-transit visualization to provide cost savings compared to in-line visualization. We begin by developing a cost model that includes factors related to both in-line and in-transit which allows comparisons to be made between the two methods. We then run a series of s...

Descripción completa

Detalles Bibliográficos
Autores principales: Kress, James, Larsen, Matthew, Choi, Jong, Kim, Mark, Wolf, Matthew, Podhorszki, Norbert, Klasky, Scott, Childs, Hank, Pugmire, David
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7295346/
http://dx.doi.org/10.1007/978-3-030-50743-5_8
_version_ 1783546633112256512
author Kress, James
Larsen, Matthew
Choi, Jong
Kim, Mark
Wolf, Matthew
Podhorszki, Norbert
Klasky, Scott
Childs, Hank
Pugmire, David
author_facet Kress, James
Larsen, Matthew
Choi, Jong
Kim, Mark
Wolf, Matthew
Podhorszki, Norbert
Klasky, Scott
Childs, Hank
Pugmire, David
author_sort Kress, James
collection PubMed
description We analyze the opportunities for in-transit visualization to provide cost savings compared to in-line visualization. We begin by developing a cost model that includes factors related to both in-line and in-transit which allows comparisons to be made between the two methods. We then run a series of studies to create a corpus of data for our model. We run two different visualization algorithms, one that is computation heavy and one that is communication heavy with concurrencies up to 32, 768 cores. Our primary results are in exploring the cost model within the context of our corpus. Our findings show that in-transit consistently achieves significant cost efficiencies by running visualization algorithms at lower concurrency, and that in many cases these efficiencies are enough to offset other costs (transfer, blocking, and additional nodes) to be cost effective overall. Finally, this work informs future studies, which can focus on choosing ideal configurations for in-transit processing that can consistently achieve cost efficiencies.
format Online
Article
Text
id pubmed-7295346
institution National Center for Biotechnology Information
language English
publishDate 2020
record_format MEDLINE/PubMed
spelling pubmed-72953462020-06-16 Opportunities for Cost Savings with In-Transit Visualization Kress, James Larsen, Matthew Choi, Jong Kim, Mark Wolf, Matthew Podhorszki, Norbert Klasky, Scott Childs, Hank Pugmire, David High Performance Computing Article We analyze the opportunities for in-transit visualization to provide cost savings compared to in-line visualization. We begin by developing a cost model that includes factors related to both in-line and in-transit which allows comparisons to be made between the two methods. We then run a series of studies to create a corpus of data for our model. We run two different visualization algorithms, one that is computation heavy and one that is communication heavy with concurrencies up to 32, 768 cores. Our primary results are in exploring the cost model within the context of our corpus. Our findings show that in-transit consistently achieves significant cost efficiencies by running visualization algorithms at lower concurrency, and that in many cases these efficiencies are enough to offset other costs (transfer, blocking, and additional nodes) to be cost effective overall. Finally, this work informs future studies, which can focus on choosing ideal configurations for in-transit processing that can consistently achieve cost efficiencies. 2020-05-22 /pmc/articles/PMC7295346/ http://dx.doi.org/10.1007/978-3-030-50743-5_8 Text en © Springer Nature Switzerland AG 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Kress, James
Larsen, Matthew
Choi, Jong
Kim, Mark
Wolf, Matthew
Podhorszki, Norbert
Klasky, Scott
Childs, Hank
Pugmire, David
Opportunities for Cost Savings with In-Transit Visualization
title Opportunities for Cost Savings with In-Transit Visualization
title_full Opportunities for Cost Savings with In-Transit Visualization
title_fullStr Opportunities for Cost Savings with In-Transit Visualization
title_full_unstemmed Opportunities for Cost Savings with In-Transit Visualization
title_short Opportunities for Cost Savings with In-Transit Visualization
title_sort opportunities for cost savings with in-transit visualization
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7295346/
http://dx.doi.org/10.1007/978-3-030-50743-5_8
work_keys_str_mv AT kressjames opportunitiesforcostsavingswithintransitvisualization
AT larsenmatthew opportunitiesforcostsavingswithintransitvisualization
AT choijong opportunitiesforcostsavingswithintransitvisualization
AT kimmark opportunitiesforcostsavingswithintransitvisualization
AT wolfmatthew opportunitiesforcostsavingswithintransitvisualization
AT podhorszkinorbert opportunitiesforcostsavingswithintransitvisualization
AT klaskyscott opportunitiesforcostsavingswithintransitvisualization
AT childshank opportunitiesforcostsavingswithintransitvisualization
AT pugmiredavid opportunitiesforcostsavingswithintransitvisualization