Cargando…

Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters

The rapidly growing power data in smart grids have created difficulties in security management. The processing of large-scale power data with the use of artificial intelligence methods has become a hotspot research topic. Considering the early warning detection problem of smart meters, this paper pr...

Descripción completa

Detalles Bibliográficos
Autores principales: Sun, Shuxian, Liu, Chunyu, Zhu, Yiqun, He, Haihang, Xiao, Shuai, Wen, Jiabao
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9653749/
https://www.ncbi.nlm.nih.gov/pubmed/36366240
http://dx.doi.org/10.3390/s22218543
_version_ 1784828757806153728
author Sun, Shuxian
Liu, Chunyu
Zhu, Yiqun
He, Haihang
Xiao, Shuai
Wen, Jiabao
author_facet Sun, Shuxian
Liu, Chunyu
Zhu, Yiqun
He, Haihang
Xiao, Shuai
Wen, Jiabao
author_sort Sun, Shuxian
collection PubMed
description The rapidly growing power data in smart grids have created difficulties in security management. The processing of large-scale power data with the use of artificial intelligence methods has become a hotspot research topic. Considering the early warning detection problem of smart meters, this paper proposes an abnormal data detection network based on Deep Reinforcement Learning, which includes a main network and a target network composed of deep learning networks. This work uses the greedy policy algorithm to find the action of the maximum value of Q based on the Q-learning method to obtain the optimal calculation policy. It also uses the reward value and discount factor to optimize the target value. In particular, this study uses the fuzzy c-means method to predict the future state information value, which improves the computational accuracy of the Deep Reinforcement Learning model. The experimental results show that compared with the traditional smart meter data anomaly detection method, the proposed model improves the accuracy of meter data anomaly detection.
format Online
Article
Text
id pubmed-9653749
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96537492022-11-15 Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters Sun, Shuxian Liu, Chunyu Zhu, Yiqun He, Haihang Xiao, Shuai Wen, Jiabao Sensors (Basel) Article The rapidly growing power data in smart grids have created difficulties in security management. The processing of large-scale power data with the use of artificial intelligence methods has become a hotspot research topic. Considering the early warning detection problem of smart meters, this paper proposes an abnormal data detection network based on Deep Reinforcement Learning, which includes a main network and a target network composed of deep learning networks. This work uses the greedy policy algorithm to find the action of the maximum value of Q based on the Q-learning method to obtain the optimal calculation policy. It also uses the reward value and discount factor to optimize the target value. In particular, this study uses the fuzzy c-means method to predict the future state information value, which improves the computational accuracy of the Deep Reinforcement Learning model. The experimental results show that compared with the traditional smart meter data anomaly detection method, the proposed model improves the accuracy of meter data anomaly detection. MDPI 2022-11-06 /pmc/articles/PMC9653749/ /pubmed/36366240 http://dx.doi.org/10.3390/s22218543 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Sun, Shuxian
Liu, Chunyu
Zhu, Yiqun
He, Haihang
Xiao, Shuai
Wen, Jiabao
Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters
title Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters
title_full Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters
title_fullStr Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters
title_full_unstemmed Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters
title_short Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters
title_sort deep reinforcement learning for the detection of abnormal data in smart meters
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9653749/
https://www.ncbi.nlm.nih.gov/pubmed/36366240
http://dx.doi.org/10.3390/s22218543
work_keys_str_mv AT sunshuxian deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters
AT liuchunyu deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters
AT zhuyiqun deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters
AT hehaihang deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters
AT xiaoshuai deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters
AT wenjiabao deepreinforcementlearningforthedetectionofabnormaldatainsmartmeters