Cargando…

SANgo: a storage infrastructure simulator with reinforcement learning support

We introduce SANgo (Storage Area Network in the Go language)—a Go-based package for simulating the behavior of modern storage infrastructure. The software is based on the discrete-event modeling paradigm and captures the structure and dynamics of high-level storage system building blocks. The flexib...

Descripción completa

Detalles Bibliográficos
Autores principales: Arzymatov, Kenenbek, Sapronov, Andrey, Belavin, Vladislav, Gremyachikh, Leonid, Karpov, Maksim, Ustyuzhanin, Andrey, Tchoub, Ivan, Ikoev, Artem
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7924704/
https://www.ncbi.nlm.nih.gov/pubmed/33816922
http://dx.doi.org/10.7717/peerj-cs.271
_version_ 1783659145494265856
author Arzymatov, Kenenbek
Sapronov, Andrey
Belavin, Vladislav
Gremyachikh, Leonid
Karpov, Maksim
Ustyuzhanin, Andrey
Tchoub, Ivan
Ikoev, Artem
author_facet Arzymatov, Kenenbek
Sapronov, Andrey
Belavin, Vladislav
Gremyachikh, Leonid
Karpov, Maksim
Ustyuzhanin, Andrey
Tchoub, Ivan
Ikoev, Artem
author_sort Arzymatov, Kenenbek
collection PubMed
description We introduce SANgo (Storage Area Network in the Go language)—a Go-based package for simulating the behavior of modern storage infrastructure. The software is based on the discrete-event modeling paradigm and captures the structure and dynamics of high-level storage system building blocks. The flexible structure of the package allows us to create a model of a real storage system with a configurable number of components. The granularity of the simulated system can be defined depending on the replicated patterns of actual system behavior. Accurate replication enables us to reach the primary goal of our simulator—to explore the stability boundaries of real storage systems. To meet this goal, SANgo offers a variety of interfaces for easy monitoring and tuning of the simulated model. These interfaces allow us to track the number of metrics of such components as storage controllers, network connections, and hard-drives. Other interfaces allow altering the parameter values of the simulated system effectively in real-time, thus providing the possibility for training a realistic digital twin using, for example, the reinforcement learning (RL) approach. One can train an RL model to reduce discrepancies between simulated and real SAN data. The external control algorithm can adjust the simulator parameters to make the difference as small as possible. SANgo supports the standard OpenAI gym interface; thus, the software can serve as a benchmark for comparison of different learning algorithms.
format Online
Article
Text
id pubmed-7924704
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-79247042021-04-02 SANgo: a storage infrastructure simulator with reinforcement learning support Arzymatov, Kenenbek Sapronov, Andrey Belavin, Vladislav Gremyachikh, Leonid Karpov, Maksim Ustyuzhanin, Andrey Tchoub, Ivan Ikoev, Artem PeerJ Comput Sci Data Mining and Machine Learning We introduce SANgo (Storage Area Network in the Go language)—a Go-based package for simulating the behavior of modern storage infrastructure. The software is based on the discrete-event modeling paradigm and captures the structure and dynamics of high-level storage system building blocks. The flexible structure of the package allows us to create a model of a real storage system with a configurable number of components. The granularity of the simulated system can be defined depending on the replicated patterns of actual system behavior. Accurate replication enables us to reach the primary goal of our simulator—to explore the stability boundaries of real storage systems. To meet this goal, SANgo offers a variety of interfaces for easy monitoring and tuning of the simulated model. These interfaces allow us to track the number of metrics of such components as storage controllers, network connections, and hard-drives. Other interfaces allow altering the parameter values of the simulated system effectively in real-time, thus providing the possibility for training a realistic digital twin using, for example, the reinforcement learning (RL) approach. One can train an RL model to reduce discrepancies between simulated and real SAN data. The external control algorithm can adjust the simulator parameters to make the difference as small as possible. SANgo supports the standard OpenAI gym interface; thus, the software can serve as a benchmark for comparison of different learning algorithms. PeerJ Inc. 2020-05-04 /pmc/articles/PMC7924704/ /pubmed/33816922 http://dx.doi.org/10.7717/peerj-cs.271 Text en ©2020 Arzymatov et al. https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited.
spellingShingle Data Mining and Machine Learning
Arzymatov, Kenenbek
Sapronov, Andrey
Belavin, Vladislav
Gremyachikh, Leonid
Karpov, Maksim
Ustyuzhanin, Andrey
Tchoub, Ivan
Ikoev, Artem
SANgo: a storage infrastructure simulator with reinforcement learning support
title SANgo: a storage infrastructure simulator with reinforcement learning support
title_full SANgo: a storage infrastructure simulator with reinforcement learning support
title_fullStr SANgo: a storage infrastructure simulator with reinforcement learning support
title_full_unstemmed SANgo: a storage infrastructure simulator with reinforcement learning support
title_short SANgo: a storage infrastructure simulator with reinforcement learning support
title_sort sango: a storage infrastructure simulator with reinforcement learning support
topic Data Mining and Machine Learning
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7924704/
https://www.ncbi.nlm.nih.gov/pubmed/33816922
http://dx.doi.org/10.7717/peerj-cs.271
work_keys_str_mv AT arzymatovkenenbek sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport
AT sapronovandrey sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport
AT belavinvladislav sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport
AT gremyachikhleonid sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport
AT karpovmaksim sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport
AT ustyuzhaninandrey sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport
AT tchoubivan sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport
AT ikoevartem sangoastorageinfrastructuresimulatorwithreinforcementlearningsupport