Cargando…

Lake eutrophication prediction based on improved MIMO-DD-3Q Learning

As for the problem that the traditional single depth prediction model has poor strain capacity to the prediction results of time series data when predicting lake eutrophication, this study takes the multi-factor water quality data affecting lake eutrophication as the main research object. A deep rei...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Li, Ning, Chaoran, Wang, Xiaoyi, Xu, Jiping, Zhao, Zhiyao, Yu, Jiabin, Zhang, Huiyan, Sun, Qian, Bai, Yuting, Jin, Xuebo, Tang, Qianhui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10645360/
https://www.ncbi.nlm.nih.gov/pubmed/37963129
http://dx.doi.org/10.1371/journal.pone.0294278
_version_ 1785147366924353536
author Wang, Li
Ning, Chaoran
Wang, Xiaoyi
Xu, Jiping
Zhao, Zhiyao
Yu, Jiabin
Zhang, Huiyan
Sun, Qian
Bai, Yuting
Jin, Xuebo
Tang, Qianhui
author_facet Wang, Li
Ning, Chaoran
Wang, Xiaoyi
Xu, Jiping
Zhao, Zhiyao
Yu, Jiabin
Zhang, Huiyan
Sun, Qian
Bai, Yuting
Jin, Xuebo
Tang, Qianhui
author_sort Wang, Li
collection PubMed
description As for the problem that the traditional single depth prediction model has poor strain capacity to the prediction results of time series data when predicting lake eutrophication, this study takes the multi-factor water quality data affecting lake eutrophication as the main research object. A deep reinforcement learning model is proposed, which can realize the mutual conversion of water quality data prediction models at different times, select the optimal prediction strategy of lake eutrophication at the current time according to its own continuous learning, and improve the reinforcement learning algorithm. Firstly, the greedy factor, the fixed parameter of Agent learning training in reinforcement learning, is introduced into an arctangent function and the mean value reward factor is defined. On this basis, three Q estimates are introduced, and the weight parameters are obtained by calculating the realistic value of Q, taking the average value and the minimum value to update the final Q table, so as to get an Improved MIMO-DD-3Q Learning model. The preliminary prediction results of lake eutrophication are obtained, and the errors obtained are used as the secondary input to continue updating the Q table to build the final Improved MIMO-DD-3Q Learning model, so as to achieve the final prediction of water eutrophication. In this study, multi-factor water quality data of Yongding River in Beijing were selected from 0:00 on July 26, 2021 to 0:00 on September 5, 2021. Firstly, data smoothing and principal component analysis were carried out to confirm that there was a certain correlation between all factors in the occurrence of lake eutrophication. Then, the Improved MIMO-DD-3Q Learning prediction model was used for experimental verification. The results show that the Improved MIMO-DD-3Q Learning model has a good effect in the field of lake eutrophication prediction.
format Online
Article
Text
id pubmed-10645360
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-106453602023-11-14 Lake eutrophication prediction based on improved MIMO-DD-3Q Learning Wang, Li Ning, Chaoran Wang, Xiaoyi Xu, Jiping Zhao, Zhiyao Yu, Jiabin Zhang, Huiyan Sun, Qian Bai, Yuting Jin, Xuebo Tang, Qianhui PLoS One Research Article As for the problem that the traditional single depth prediction model has poor strain capacity to the prediction results of time series data when predicting lake eutrophication, this study takes the multi-factor water quality data affecting lake eutrophication as the main research object. A deep reinforcement learning model is proposed, which can realize the mutual conversion of water quality data prediction models at different times, select the optimal prediction strategy of lake eutrophication at the current time according to its own continuous learning, and improve the reinforcement learning algorithm. Firstly, the greedy factor, the fixed parameter of Agent learning training in reinforcement learning, is introduced into an arctangent function and the mean value reward factor is defined. On this basis, three Q estimates are introduced, and the weight parameters are obtained by calculating the realistic value of Q, taking the average value and the minimum value to update the final Q table, so as to get an Improved MIMO-DD-3Q Learning model. The preliminary prediction results of lake eutrophication are obtained, and the errors obtained are used as the secondary input to continue updating the Q table to build the final Improved MIMO-DD-3Q Learning model, so as to achieve the final prediction of water eutrophication. In this study, multi-factor water quality data of Yongding River in Beijing were selected from 0:00 on July 26, 2021 to 0:00 on September 5, 2021. Firstly, data smoothing and principal component analysis were carried out to confirm that there was a certain correlation between all factors in the occurrence of lake eutrophication. Then, the Improved MIMO-DD-3Q Learning prediction model was used for experimental verification. The results show that the Improved MIMO-DD-3Q Learning model has a good effect in the field of lake eutrophication prediction. Public Library of Science 2023-11-14 /pmc/articles/PMC10645360/ /pubmed/37963129 http://dx.doi.org/10.1371/journal.pone.0294278 Text en © 2023 Wang et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Wang, Li
Ning, Chaoran
Wang, Xiaoyi
Xu, Jiping
Zhao, Zhiyao
Yu, Jiabin
Zhang, Huiyan
Sun, Qian
Bai, Yuting
Jin, Xuebo
Tang, Qianhui
Lake eutrophication prediction based on improved MIMO-DD-3Q Learning
title Lake eutrophication prediction based on improved MIMO-DD-3Q Learning
title_full Lake eutrophication prediction based on improved MIMO-DD-3Q Learning
title_fullStr Lake eutrophication prediction based on improved MIMO-DD-3Q Learning
title_full_unstemmed Lake eutrophication prediction based on improved MIMO-DD-3Q Learning
title_short Lake eutrophication prediction based on improved MIMO-DD-3Q Learning
title_sort lake eutrophication prediction based on improved mimo-dd-3q learning
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10645360/
https://www.ncbi.nlm.nih.gov/pubmed/37963129
http://dx.doi.org/10.1371/journal.pone.0294278
work_keys_str_mv AT wangli lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT ningchaoran lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT wangxiaoyi lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT xujiping lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT zhaozhiyao lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT yujiabin lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT zhanghuiyan lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT sunqian lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT baiyuting lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT jinxuebo lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning
AT tangqianhui lakeeutrophicationpredictionbasedonimprovedmimodd3qlearning