Cargando…

Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms

With the development of artificial intelligence, intelligent communication jamming decision making is an important research direction of cognitive electronic warfare. In this paper, we consider a complex intelligent jamming decision scenario in which both communication parties choose to adjust physi...

Descripción completa

Detalles Bibliográficos
Autores principales: Xu, Yuting, Wang, Chao, Liang, Jiakai, Yue, Keqiang, Li, Wenjun, Zheng, Shilian, Zhao, Zhijin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9601320/
https://www.ncbi.nlm.nih.gov/pubmed/37420461
http://dx.doi.org/10.3390/e24101441
_version_ 1784817034503127040
author Xu, Yuting
Wang, Chao
Liang, Jiakai
Yue, Keqiang
Li, Wenjun
Zheng, Shilian
Zhao, Zhijin
author_facet Xu, Yuting
Wang, Chao
Liang, Jiakai
Yue, Keqiang
Li, Wenjun
Zheng, Shilian
Zhao, Zhijin
author_sort Xu, Yuting
collection PubMed
description With the development of artificial intelligence, intelligent communication jamming decision making is an important research direction of cognitive electronic warfare. In this paper, we consider a complex intelligent jamming decision scenario in which both communication parties choose to adjust physical layer parameters to avoid jamming in a non-cooperative scenario and the jammer achieves accurate jamming by interacting with the environment. However, when the situation becomes complex and large in number, traditional reinforcement learning suffers from the problems of failure to converge and a high number of interactions, which are fatal and unrealistic in a real warfare environment. To solve this problem, we propose a deep reinforcement learning based and maximum-entropy-based soft actor-critic (SAC) algorithm. In the proposed algorithm, we add an improved Wolpertinger architecture to the original SAC algorithm in order to reduce the number of interactions and improve the accuracy of the algorithm. The results show that the proposed algorithm shows excellent performance in various scenarios of jamming and achieves accurate, fast, and continuous jamming for both sides of the communication.
format Online
Article
Text
id pubmed-9601320
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96013202022-10-27 Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms Xu, Yuting Wang, Chao Liang, Jiakai Yue, Keqiang Li, Wenjun Zheng, Shilian Zhao, Zhijin Entropy (Basel) Article With the development of artificial intelligence, intelligent communication jamming decision making is an important research direction of cognitive electronic warfare. In this paper, we consider a complex intelligent jamming decision scenario in which both communication parties choose to adjust physical layer parameters to avoid jamming in a non-cooperative scenario and the jammer achieves accurate jamming by interacting with the environment. However, when the situation becomes complex and large in number, traditional reinforcement learning suffers from the problems of failure to converge and a high number of interactions, which are fatal and unrealistic in a real warfare environment. To solve this problem, we propose a deep reinforcement learning based and maximum-entropy-based soft actor-critic (SAC) algorithm. In the proposed algorithm, we add an improved Wolpertinger architecture to the original SAC algorithm in order to reduce the number of interactions and improve the accuracy of the algorithm. The results show that the proposed algorithm shows excellent performance in various scenarios of jamming and achieves accurate, fast, and continuous jamming for both sides of the communication. MDPI 2022-10-10 /pmc/articles/PMC9601320/ /pubmed/37420461 http://dx.doi.org/10.3390/e24101441 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Xu, Yuting
Wang, Chao
Liang, Jiakai
Yue, Keqiang
Li, Wenjun
Zheng, Shilian
Zhao, Zhijin
Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms
title Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms
title_full Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms
title_fullStr Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms
title_full_unstemmed Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms
title_short Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms
title_sort deep reinforcement learning based decision making for complex jamming waveforms
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9601320/
https://www.ncbi.nlm.nih.gov/pubmed/37420461
http://dx.doi.org/10.3390/e24101441
work_keys_str_mv AT xuyuting deepreinforcementlearningbaseddecisionmakingforcomplexjammingwaveforms
AT wangchao deepreinforcementlearningbaseddecisionmakingforcomplexjammingwaveforms
AT liangjiakai deepreinforcementlearningbaseddecisionmakingforcomplexjammingwaveforms
AT yuekeqiang deepreinforcementlearningbaseddecisionmakingforcomplexjammingwaveforms
AT liwenjun deepreinforcementlearningbaseddecisionmakingforcomplexjammingwaveforms
AT zhengshilian deepreinforcementlearningbaseddecisionmakingforcomplexjammingwaveforms
AT zhaozhijin deepreinforcementlearningbaseddecisionmakingforcomplexjammingwaveforms