Cargando…
A reinforcement learning‐based hybrid modeling framework for bioprocess kinetics identification
Constructing predictive models to simulate complex bioprocess dynamics, particularly time‐varying (i.e., parameters varying over time) and history‐dependent (i.e., current kinetics dependent on historical culture conditions) behavior, has been a longstanding research challenge. Current advances in h...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley and Sons Inc.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10092184/ https://www.ncbi.nlm.nih.gov/pubmed/36225098 http://dx.doi.org/10.1002/bit.28262 |
_version_ | 1785023286849044480 |
---|---|
author | Mowbray, Max R. Wu, Chufan Rogers, Alexander W. Rio‐Chanona, Ehecatl A. Del Zhang, Dongda |
author_facet | Mowbray, Max R. Wu, Chufan Rogers, Alexander W. Rio‐Chanona, Ehecatl A. Del Zhang, Dongda |
author_sort | Mowbray, Max R. |
collection | PubMed |
description | Constructing predictive models to simulate complex bioprocess dynamics, particularly time‐varying (i.e., parameters varying over time) and history‐dependent (i.e., current kinetics dependent on historical culture conditions) behavior, has been a longstanding research challenge. Current advances in hybrid modeling offer a solution to this by integrating kinetic models with data‐driven techniques. This article proposes a novel two‐step framework: first (i) speculate and combine several possible kinetic model structures sourced from process and phenomenological knowledge, then (ii) identify the most likely kinetic model structure and its parameter values using model‐free Reinforcement Learning (RL). Specifically, Step 1 collates feasible history‐dependent model structures, then Step 2 uses RL to simultaneously identify the correct model structure and the time‐varying parameter trajectories. To demonstrate the performance of this framework, a range of in‐silico case studies were carried out. The results show that the proposed framework can efficiently construct high‐fidelity models to quantify both time‐varying and history‐dependent kinetic behaviors while minimizing the risks of over‐parametrization and over‐fitting. Finally, the primary advantages of the proposed framework and its limitation were thoroughly discussed in comparison to other existing hybrid modeling and model structure identification techniques, highlighting the potential of this framework for general bioprocess modeling. |
format | Online Article Text |
id | pubmed-10092184 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | John Wiley and Sons Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-100921842023-04-13 A reinforcement learning‐based hybrid modeling framework for bioprocess kinetics identification Mowbray, Max R. Wu, Chufan Rogers, Alexander W. Rio‐Chanona, Ehecatl A. Del Zhang, Dongda Biotechnol Bioeng ARTICLES Constructing predictive models to simulate complex bioprocess dynamics, particularly time‐varying (i.e., parameters varying over time) and history‐dependent (i.e., current kinetics dependent on historical culture conditions) behavior, has been a longstanding research challenge. Current advances in hybrid modeling offer a solution to this by integrating kinetic models with data‐driven techniques. This article proposes a novel two‐step framework: first (i) speculate and combine several possible kinetic model structures sourced from process and phenomenological knowledge, then (ii) identify the most likely kinetic model structure and its parameter values using model‐free Reinforcement Learning (RL). Specifically, Step 1 collates feasible history‐dependent model structures, then Step 2 uses RL to simultaneously identify the correct model structure and the time‐varying parameter trajectories. To demonstrate the performance of this framework, a range of in‐silico case studies were carried out. The results show that the proposed framework can efficiently construct high‐fidelity models to quantify both time‐varying and history‐dependent kinetic behaviors while minimizing the risks of over‐parametrization and over‐fitting. Finally, the primary advantages of the proposed framework and its limitation were thoroughly discussed in comparison to other existing hybrid modeling and model structure identification techniques, highlighting the potential of this framework for general bioprocess modeling. John Wiley and Sons Inc. 2022-10-26 2023-01 /pmc/articles/PMC10092184/ /pubmed/36225098 http://dx.doi.org/10.1002/bit.28262 Text en © 2022 The Authors. Biotechnology and Bioengineering published by Wiley Periodicals LLC. https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | ARTICLES Mowbray, Max R. Wu, Chufan Rogers, Alexander W. Rio‐Chanona, Ehecatl A. Del Zhang, Dongda A reinforcement learning‐based hybrid modeling framework for bioprocess kinetics identification |
title | A reinforcement learning‐based hybrid modeling framework for bioprocess kinetics identification |
title_full | A reinforcement learning‐based hybrid modeling framework for bioprocess kinetics identification |
title_fullStr | A reinforcement learning‐based hybrid modeling framework for bioprocess kinetics identification |
title_full_unstemmed | A reinforcement learning‐based hybrid modeling framework for bioprocess kinetics identification |
title_short | A reinforcement learning‐based hybrid modeling framework for bioprocess kinetics identification |
title_sort | reinforcement learning‐based hybrid modeling framework for bioprocess kinetics identification |
topic | ARTICLES |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10092184/ https://www.ncbi.nlm.nih.gov/pubmed/36225098 http://dx.doi.org/10.1002/bit.28262 |
work_keys_str_mv | AT mowbraymaxr areinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification AT wuchufan areinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification AT rogersalexanderw areinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification AT riochanonaehecatladel areinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification AT zhangdongda areinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification AT mowbraymaxr reinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification AT wuchufan reinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification AT rogersalexanderw reinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification AT riochanonaehecatladel reinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification AT zhangdongda reinforcementlearningbasedhybridmodelingframeworkforbioprocesskineticsidentification |