Cargando…

IoT-Based Reinforcement Learning Using Probabilistic Model for Determining Extensive Exploration through Computational Intelligence for Next-Generation Techniques

Computing intelligence is built on several learning and optimization techniques. Incorporating cutting-edge learning techniques to balance the interaction between exploitation and exploration is therefore an inspiring field, especially when it is combined with IoT. The reinforcement learning techniq...

Descripción completa

Detalles Bibliográficos
Autores principales: Tiwari, Pradeep Kumar, Singh, Pooja, Rajagopal, Navaneetha Krishnan, Deepa, K., Gulavani, Sampada, Verma, Amit, Kumar, Yekula Prasanna
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10581845/
https://www.ncbi.nlm.nih.gov/pubmed/37854640
http://dx.doi.org/10.1155/2023/5113417
_version_ 1785122206474305536
author Tiwari, Pradeep Kumar
Singh, Pooja
Rajagopal, Navaneetha Krishnan
Deepa, K.
Gulavani, Sampada
Verma, Amit
Kumar, Yekula Prasanna
author_facet Tiwari, Pradeep Kumar
Singh, Pooja
Rajagopal, Navaneetha Krishnan
Deepa, K.
Gulavani, Sampada
Verma, Amit
Kumar, Yekula Prasanna
author_sort Tiwari, Pradeep Kumar
collection PubMed
description Computing intelligence is built on several learning and optimization techniques. Incorporating cutting-edge learning techniques to balance the interaction between exploitation and exploration is therefore an inspiring field, especially when it is combined with IoT. The reinforcement learning techniques created in recent years have largely focused on incorporating deep learning technology to improve the generalization skills of the algorithm while ignoring the issue of detecting and taking full advantage of the dilemma. To increase the effectiveness of exploration, a deep reinforcement algorithm based on computational intelligence is proposed in this study, using intelligent sensors and the Bayesian approach. In addition, the technique for computing the posterior distribution of parameters in Bayesian linear regression is expanded to nonlinear models such as artificial neural networks. The Bayesian Bootstrap Deep Q-Network (BBDQN) algorithm is created by combining the bootstrapped DQN with the recommended computing technique. Finally, tests in two scenarios demonstrate that, when faced with severe exploration problems, BBDQN outperforms DQN and bootstrapped DQN in terms of exploration efficiency.
format Online
Article
Text
id pubmed-10581845
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-105818452023-10-18 IoT-Based Reinforcement Learning Using Probabilistic Model for Determining Extensive Exploration through Computational Intelligence for Next-Generation Techniques Tiwari, Pradeep Kumar Singh, Pooja Rajagopal, Navaneetha Krishnan Deepa, K. Gulavani, Sampada Verma, Amit Kumar, Yekula Prasanna Comput Intell Neurosci Research Article Computing intelligence is built on several learning and optimization techniques. Incorporating cutting-edge learning techniques to balance the interaction between exploitation and exploration is therefore an inspiring field, especially when it is combined with IoT. The reinforcement learning techniques created in recent years have largely focused on incorporating deep learning technology to improve the generalization skills of the algorithm while ignoring the issue of detecting and taking full advantage of the dilemma. To increase the effectiveness of exploration, a deep reinforcement algorithm based on computational intelligence is proposed in this study, using intelligent sensors and the Bayesian approach. In addition, the technique for computing the posterior distribution of parameters in Bayesian linear regression is expanded to nonlinear models such as artificial neural networks. The Bayesian Bootstrap Deep Q-Network (BBDQN) algorithm is created by combining the bootstrapped DQN with the recommended computing technique. Finally, tests in two scenarios demonstrate that, when faced with severe exploration problems, BBDQN outperforms DQN and bootstrapped DQN in terms of exploration efficiency. Hindawi 2023-10-10 /pmc/articles/PMC10581845/ /pubmed/37854640 http://dx.doi.org/10.1155/2023/5113417 Text en Copyright © 2023 Pradeep Kumar Tiwari et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Tiwari, Pradeep Kumar
Singh, Pooja
Rajagopal, Navaneetha Krishnan
Deepa, K.
Gulavani, Sampada
Verma, Amit
Kumar, Yekula Prasanna
IoT-Based Reinforcement Learning Using Probabilistic Model for Determining Extensive Exploration through Computational Intelligence for Next-Generation Techniques
title IoT-Based Reinforcement Learning Using Probabilistic Model for Determining Extensive Exploration through Computational Intelligence for Next-Generation Techniques
title_full IoT-Based Reinforcement Learning Using Probabilistic Model for Determining Extensive Exploration through Computational Intelligence for Next-Generation Techniques
title_fullStr IoT-Based Reinforcement Learning Using Probabilistic Model for Determining Extensive Exploration through Computational Intelligence for Next-Generation Techniques
title_full_unstemmed IoT-Based Reinforcement Learning Using Probabilistic Model for Determining Extensive Exploration through Computational Intelligence for Next-Generation Techniques
title_short IoT-Based Reinforcement Learning Using Probabilistic Model for Determining Extensive Exploration through Computational Intelligence for Next-Generation Techniques
title_sort iot-based reinforcement learning using probabilistic model for determining extensive exploration through computational intelligence for next-generation techniques
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10581845/
https://www.ncbi.nlm.nih.gov/pubmed/37854640
http://dx.doi.org/10.1155/2023/5113417
work_keys_str_mv AT tiwaripradeepkumar iotbasedreinforcementlearningusingprobabilisticmodelfordeterminingextensiveexplorationthroughcomputationalintelligencefornextgenerationtechniques
AT singhpooja iotbasedreinforcementlearningusingprobabilisticmodelfordeterminingextensiveexplorationthroughcomputationalintelligencefornextgenerationtechniques
AT rajagopalnavaneethakrishnan iotbasedreinforcementlearningusingprobabilisticmodelfordeterminingextensiveexplorationthroughcomputationalintelligencefornextgenerationtechniques
AT deepak iotbasedreinforcementlearningusingprobabilisticmodelfordeterminingextensiveexplorationthroughcomputationalintelligencefornextgenerationtechniques
AT gulavanisampada iotbasedreinforcementlearningusingprobabilisticmodelfordeterminingextensiveexplorationthroughcomputationalintelligencefornextgenerationtechniques
AT vermaamit iotbasedreinforcementlearningusingprobabilisticmodelfordeterminingextensiveexplorationthroughcomputationalintelligencefornextgenerationtechniques
AT kumaryekulaprasanna iotbasedreinforcementlearningusingprobabilisticmodelfordeterminingextensiveexplorationthroughcomputationalintelligencefornextgenerationtechniques