Cargando…
Autotuning of Exascale Applications With Anomalies Detection
The execution of complex distributed applications in exascale systems faces many challenges, as it involves empirical evaluation of countless code variations and application runtime parameters over a heterogeneous set of resources. To mitigate these challenges, the research field of autotuning has g...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8661695/ https://www.ncbi.nlm.nih.gov/pubmed/34901840 http://dx.doi.org/10.3389/fdata.2021.657218 |
_version_ | 1784613386541072384 |
---|---|
author | Kimovski, Dragi Mathá, Roland Iuhasz, Gabriel Marozzo, Fabrizio Petcu, Dana Prodan, Radu |
author_facet | Kimovski, Dragi Mathá, Roland Iuhasz, Gabriel Marozzo, Fabrizio Petcu, Dana Prodan, Radu |
author_sort | Kimovski, Dragi |
collection | PubMed |
description | The execution of complex distributed applications in exascale systems faces many challenges, as it involves empirical evaluation of countless code variations and application runtime parameters over a heterogeneous set of resources. To mitigate these challenges, the research field of autotuning has gained momentum. The autotuning automates identifying the most desirable application implementation in terms of code variations and runtime parameters. However, the complexity and size of the exascale systems make the autotuning process very difficult, especially considering the number of parameter variations that have to be identified. Therefore, we introduce a novel approach for autotuning exascale applications based on a genetic multi-objective optimization algorithm integrated within the ASPIDE exascale computing framework. The approach considers multi-dimensional search space with support for pluggable objective functions, including execution time and energy requirements. Furthermore, the autotuner employs a machine learning-based event detection approach to detect events and anomalies during application execution, such as hardware failures or communication bottlenecks. |
format | Online Article Text |
id | pubmed-8661695 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-86616952021-12-11 Autotuning of Exascale Applications With Anomalies Detection Kimovski, Dragi Mathá, Roland Iuhasz, Gabriel Marozzo, Fabrizio Petcu, Dana Prodan, Radu Front Big Data Big Data The execution of complex distributed applications in exascale systems faces many challenges, as it involves empirical evaluation of countless code variations and application runtime parameters over a heterogeneous set of resources. To mitigate these challenges, the research field of autotuning has gained momentum. The autotuning automates identifying the most desirable application implementation in terms of code variations and runtime parameters. However, the complexity and size of the exascale systems make the autotuning process very difficult, especially considering the number of parameter variations that have to be identified. Therefore, we introduce a novel approach for autotuning exascale applications based on a genetic multi-objective optimization algorithm integrated within the ASPIDE exascale computing framework. The approach considers multi-dimensional search space with support for pluggable objective functions, including execution time and energy requirements. Furthermore, the autotuner employs a machine learning-based event detection approach to detect events and anomalies during application execution, such as hardware failures or communication bottlenecks. Frontiers Media S.A. 2021-11-26 /pmc/articles/PMC8661695/ /pubmed/34901840 http://dx.doi.org/10.3389/fdata.2021.657218 Text en Copyright © 2021 Kimovski, Mathá, Iuhasz, Marozzo, Petcu and Prodan. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Big Data Kimovski, Dragi Mathá, Roland Iuhasz, Gabriel Marozzo, Fabrizio Petcu, Dana Prodan, Radu Autotuning of Exascale Applications With Anomalies Detection |
title | Autotuning of Exascale Applications With Anomalies Detection |
title_full | Autotuning of Exascale Applications With Anomalies Detection |
title_fullStr | Autotuning of Exascale Applications With Anomalies Detection |
title_full_unstemmed | Autotuning of Exascale Applications With Anomalies Detection |
title_short | Autotuning of Exascale Applications With Anomalies Detection |
title_sort | autotuning of exascale applications with anomalies detection |
topic | Big Data |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8661695/ https://www.ncbi.nlm.nih.gov/pubmed/34901840 http://dx.doi.org/10.3389/fdata.2021.657218 |
work_keys_str_mv | AT kimovskidragi autotuningofexascaleapplicationswithanomaliesdetection AT matharoland autotuningofexascaleapplicationswithanomaliesdetection AT iuhaszgabriel autotuningofexascaleapplicationswithanomaliesdetection AT marozzofabrizio autotuningofexascaleapplicationswithanomaliesdetection AT petcudana autotuningofexascaleapplicationswithanomaliesdetection AT prodanradu autotuningofexascaleapplicationswithanomaliesdetection |