Cargando…
Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters
The rapidly growing power data in smart grids have created difficulties in security management. The processing of large-scale power data with the use of artificial intelligence methods has become a hotspot research topic. Considering the early warning detection problem of smart meters, this paper pr...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9653749/ https://www.ncbi.nlm.nih.gov/pubmed/36366240 http://dx.doi.org/10.3390/s22218543 |
_version_ | 1784828757806153728 |
---|---|
author | Sun, Shuxian Liu, Chunyu Zhu, Yiqun He, Haihang Xiao, Shuai Wen, Jiabao |
author_facet | Sun, Shuxian Liu, Chunyu Zhu, Yiqun He, Haihang Xiao, Shuai Wen, Jiabao |
author_sort | Sun, Shuxian |
collection | PubMed |
description | The rapidly growing power data in smart grids have created difficulties in security management. The processing of large-scale power data with the use of artificial intelligence methods has become a hotspot research topic. Considering the early warning detection problem of smart meters, this paper proposes an abnormal data detection network based on Deep Reinforcement Learning, which includes a main network and a target network composed of deep learning networks. This work uses the greedy policy algorithm to find the action of the maximum value of Q based on the Q-learning method to obtain the optimal calculation policy. It also uses the reward value and discount factor to optimize the target value. In particular, this study uses the fuzzy c-means method to predict the future state information value, which improves the computational accuracy of the Deep Reinforcement Learning model. The experimental results show that compared with the traditional smart meter data anomaly detection method, the proposed model improves the accuracy of meter data anomaly detection. |
format | Online Article Text |
id | pubmed-9653749 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-96537492022-11-15 Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters Sun, Shuxian Liu, Chunyu Zhu, Yiqun He, Haihang Xiao, Shuai Wen, Jiabao Sensors (Basel) Article The rapidly growing power data in smart grids have created difficulties in security management. The processing of large-scale power data with the use of artificial intelligence methods has become a hotspot research topic. Considering the early warning detection problem of smart meters, this paper proposes an abnormal data detection network based on Deep Reinforcement Learning, which includes a main network and a target network composed of deep learning networks. This work uses the greedy policy algorithm to find the action of the maximum value of Q based on the Q-learning method to obtain the optimal calculation policy. It also uses the reward value and discount factor to optimize the target value. In particular, this study uses the fuzzy c-means method to predict the future state information value, which improves the computational accuracy of the Deep Reinforcement Learning model. The experimental results show that compared with the traditional smart meter data anomaly detection method, the proposed model improves the accuracy of meter data anomaly detection. MDPI 2022-11-06 /pmc/articles/PMC9653749/ /pubmed/36366240 http://dx.doi.org/10.3390/s22218543 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Sun, Shuxian Liu, Chunyu Zhu, Yiqun He, Haihang Xiao, Shuai Wen, Jiabao Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters |
title | Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters |
title_full | Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters |
title_fullStr | Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters |
title_full_unstemmed | Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters |
title_short | Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters |
title_sort | deep reinforcement learning for the detection of abnormal data in smart meters |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9653749/ https://www.ncbi.nlm.nih.gov/pubmed/36366240 http://dx.doi.org/10.3390/s22218543 |
work_keys_str_mv | AT sunshuxian deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters AT liuchunyu deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters AT zhuyiqun deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters AT hehaihang deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters AT xiaoshuai deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters AT wenjiabao deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters |