Cargando…

Reinforcement Learning-Based Decentralized Safety Control for Constrained Interconnected Nonlinear Safety-Critical Systems

This paper addresses the problem of decentralized safety control (DSC) of constrained interconnected nonlinear safety-critical systems under reinforcement learning strategies, where asymmetric input constraints and security constraints are considered. To begin with, improved performance functions as...

Descripción completa

Detalles Bibliográficos
Autores principales: Qin, Chunbin, Wu, Yinliang, Zhang, Jishi, Zhu, Tianzeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453656/
https://www.ncbi.nlm.nih.gov/pubmed/37628188
http://dx.doi.org/10.3390/e25081158
_version_ 1785095990568550400
author Qin, Chunbin
Wu, Yinliang
Zhang, Jishi
Zhu, Tianzeng
author_facet Qin, Chunbin
Wu, Yinliang
Zhang, Jishi
Zhu, Tianzeng
author_sort Qin, Chunbin
collection PubMed
description This paper addresses the problem of decentralized safety control (DSC) of constrained interconnected nonlinear safety-critical systems under reinforcement learning strategies, where asymmetric input constraints and security constraints are considered. To begin with, improved performance functions associated with the actuator estimates for each auxiliary subsystem are constructed. Then, the decentralized control problem with security constraints and asymmetric input constraints is transformed into an equivalent decentralized control problem with asymmetric input constraints using the barrier function. This approach ensures that safety-critical systems operate and learn optimal DSC policies within their safe global domains. Then, the optimal control strategy is shown to ensure that the entire system is uniformly ultimately bounded (UUB). In addition, all signals in the closed-loop auxiliary subsystem, based on Lyapunov theory, are uniformly ultimately bounded, and the effectiveness of the designed method is verified by practical simulation.
format Online
Article
Text
id pubmed-10453656
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104536562023-08-26 Reinforcement Learning-Based Decentralized Safety Control for Constrained Interconnected Nonlinear Safety-Critical Systems Qin, Chunbin Wu, Yinliang Zhang, Jishi Zhu, Tianzeng Entropy (Basel) Article This paper addresses the problem of decentralized safety control (DSC) of constrained interconnected nonlinear safety-critical systems under reinforcement learning strategies, where asymmetric input constraints and security constraints are considered. To begin with, improved performance functions associated with the actuator estimates for each auxiliary subsystem are constructed. Then, the decentralized control problem with security constraints and asymmetric input constraints is transformed into an equivalent decentralized control problem with asymmetric input constraints using the barrier function. This approach ensures that safety-critical systems operate and learn optimal DSC policies within their safe global domains. Then, the optimal control strategy is shown to ensure that the entire system is uniformly ultimately bounded (UUB). In addition, all signals in the closed-loop auxiliary subsystem, based on Lyapunov theory, are uniformly ultimately bounded, and the effectiveness of the designed method is verified by practical simulation. MDPI 2023-08-02 /pmc/articles/PMC10453656/ /pubmed/37628188 http://dx.doi.org/10.3390/e25081158 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Qin, Chunbin
Wu, Yinliang
Zhang, Jishi
Zhu, Tianzeng
Reinforcement Learning-Based Decentralized Safety Control for Constrained Interconnected Nonlinear Safety-Critical Systems
title Reinforcement Learning-Based Decentralized Safety Control for Constrained Interconnected Nonlinear Safety-Critical Systems
title_full Reinforcement Learning-Based Decentralized Safety Control for Constrained Interconnected Nonlinear Safety-Critical Systems
title_fullStr Reinforcement Learning-Based Decentralized Safety Control for Constrained Interconnected Nonlinear Safety-Critical Systems
title_full_unstemmed Reinforcement Learning-Based Decentralized Safety Control for Constrained Interconnected Nonlinear Safety-Critical Systems
title_short Reinforcement Learning-Based Decentralized Safety Control for Constrained Interconnected Nonlinear Safety-Critical Systems
title_sort reinforcement learning-based decentralized safety control for constrained interconnected nonlinear safety-critical systems
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453656/
https://www.ncbi.nlm.nih.gov/pubmed/37628188
http://dx.doi.org/10.3390/e25081158
work_keys_str_mv AT qinchunbin reinforcementlearningbaseddecentralizedsafetycontrolforconstrainedinterconnectednonlinearsafetycriticalsystems
AT wuyinliang reinforcementlearningbaseddecentralizedsafetycontrolforconstrainedinterconnectednonlinearsafetycriticalsystems
AT zhangjishi reinforcementlearningbaseddecentralizedsafetycontrolforconstrainedinterconnectednonlinearsafetycriticalsystems
AT zhutianzeng reinforcementlearningbaseddecentralizedsafetycontrolforconstrainedinterconnectednonlinearsafetycriticalsystems