Cargando…
SANgo: a storage infrastructure simulator with reinforcement learning support
We introduce SANgo (Storage Area Network in the Go language)—a Go-based package for simulating the behavior of modern storage infrastructure. The software is based on the discrete-event modeling paradigm and captures the structure and dynamics of high-level storage system building blocks. The flexib...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
PeerJ Inc.
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7924704/ https://www.ncbi.nlm.nih.gov/pubmed/33816922 http://dx.doi.org/10.7717/peerj-cs.271 |
_version_ | 1783659145494265856 |
---|---|
author | Arzymatov, Kenenbek Sapronov, Andrey Belavin, Vladislav Gremyachikh, Leonid Karpov, Maksim Ustyuzhanin, Andrey Tchoub, Ivan Ikoev, Artem |
author_facet | Arzymatov, Kenenbek Sapronov, Andrey Belavin, Vladislav Gremyachikh, Leonid Karpov, Maksim Ustyuzhanin, Andrey Tchoub, Ivan Ikoev, Artem |
author_sort | Arzymatov, Kenenbek |
collection | PubMed |
description | We introduce SANgo (Storage Area Network in the Go language)—a Go-based package for simulating the behavior of modern storage infrastructure. The software is based on the discrete-event modeling paradigm and captures the structure and dynamics of high-level storage system building blocks. The flexible structure of the package allows us to create a model of a real storage system with a configurable number of components. The granularity of the simulated system can be defined depending on the replicated patterns of actual system behavior. Accurate replication enables us to reach the primary goal of our simulator—to explore the stability boundaries of real storage systems. To meet this goal, SANgo offers a variety of interfaces for easy monitoring and tuning of the simulated model. These interfaces allow us to track the number of metrics of such components as storage controllers, network connections, and hard-drives. Other interfaces allow altering the parameter values of the simulated system effectively in real-time, thus providing the possibility for training a realistic digital twin using, for example, the reinforcement learning (RL) approach. One can train an RL model to reduce discrepancies between simulated and real SAN data. The external control algorithm can adjust the simulator parameters to make the difference as small as possible. SANgo supports the standard OpenAI gym interface; thus, the software can serve as a benchmark for comparison of different learning algorithms. |
format | Online Article Text |
id | pubmed-7924704 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | PeerJ Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-79247042021-04-02 SANgo: a storage infrastructure simulator with reinforcement learning support Arzymatov, Kenenbek Sapronov, Andrey Belavin, Vladislav Gremyachikh, Leonid Karpov, Maksim Ustyuzhanin, Andrey Tchoub, Ivan Ikoev, Artem PeerJ Comput Sci Data Mining and Machine Learning We introduce SANgo (Storage Area Network in the Go language)—a Go-based package for simulating the behavior of modern storage infrastructure. The software is based on the discrete-event modeling paradigm and captures the structure and dynamics of high-level storage system building blocks. The flexible structure of the package allows us to create a model of a real storage system with a configurable number of components. The granularity of the simulated system can be defined depending on the replicated patterns of actual system behavior. Accurate replication enables us to reach the primary goal of our simulator—to explore the stability boundaries of real storage systems. To meet this goal, SANgo offers a variety of interfaces for easy monitoring and tuning of the simulated model. These interfaces allow us to track the number of metrics of such components as storage controllers, network connections, and hard-drives. Other interfaces allow altering the parameter values of the simulated system effectively in real-time, thus providing the possibility for training a realistic digital twin using, for example, the reinforcement learning (RL) approach. One can train an RL model to reduce discrepancies between simulated and real SAN data. The external control algorithm can adjust the simulator parameters to make the difference as small as possible. SANgo supports the standard OpenAI gym interface; thus, the software can serve as a benchmark for comparison of different learning algorithms. PeerJ Inc. 2020-05-04 /pmc/articles/PMC7924704/ /pubmed/33816922 http://dx.doi.org/10.7717/peerj-cs.271 Text en ©2020 Arzymatov et al. https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited. |
spellingShingle | Data Mining and Machine Learning Arzymatov, Kenenbek Sapronov, Andrey Belavin, Vladislav Gremyachikh, Leonid Karpov, Maksim Ustyuzhanin, Andrey Tchoub, Ivan Ikoev, Artem SANgo: a storage infrastructure simulator with reinforcement learning support |
title | SANgo: a storage infrastructure simulator with reinforcement learning support |
title_full | SANgo: a storage infrastructure simulator with reinforcement learning support |
title_fullStr | SANgo: a storage infrastructure simulator with reinforcement learning support |
title_full_unstemmed | SANgo: a storage infrastructure simulator with reinforcement learning support |
title_short | SANgo: a storage infrastructure simulator with reinforcement learning support |
title_sort | sango: a storage infrastructure simulator with reinforcement learning support |
topic | Data Mining and Machine Learning |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7924704/ https://www.ncbi.nlm.nih.gov/pubmed/33816922 http://dx.doi.org/10.7717/peerj-cs.271 |
work_keys_str_mv | AT arzymatovkenenbek sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport AT sapronovandrey sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport AT belavinvladislav sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport AT gremyachikhleonid sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport AT karpovmaksim sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport AT ustyuzhaninandrey sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport AT tchoubivan sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport AT ikoevartem sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport |