Cargando…
A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction
[Image: see text] The data collected from complex process industries are usually time series with considerable nonlinearities and dynamics, as well as excessive redundancy. Moreover, there are temporal and spatial correlations between input variables and key performance variables. These characterist...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
American Chemical Society
2023
|
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10099443/ https://www.ncbi.nlm.nih.gov/pubmed/37065070 http://dx.doi.org/10.1021/acsomega.2c08205 |
_version_ | 1785025054184046592 |
---|---|
author | Wu, Xiuliang Sun, Kai Cao, Maoyong |
author_facet | Wu, Xiuliang Sun, Kai Cao, Maoyong |
author_sort | Wu, Xiuliang |
collection | PubMed |
description | [Image: see text] The data collected from complex process industries are usually time series with considerable nonlinearities and dynamics, as well as excessive redundancy. Moreover, there are temporal and spatial correlations between input variables and key performance variables. These characteristics bring great difficulties to data-driven modeling of the key performance variables. To overcome the problems, a new regularized spatiotemporal attention (STA)-based long short-term memory (LSTM) was developed. First, a standard LSTM network with an STA module was trained to capture the dynamic relationship between input and target variables. Second, the least absolute shrinkage and selection operator was introduced to optimize the STA module. Third, the hyperparameter representing the regularization strength of the algorithm was determined using a moving window cross-validation strategy. Finally, the proposed algorithm was compared to other state-of-the-art algorithms using artificial data, and then it was used to predict the nitrogen oxide emissions of a selective catalytic reduction denitration system. Simulation results showed that the proposed algorithm achieved more accurate predictions than the other algorithms. Furthermore, the statistics and analysis of the importance of the variables are consistent with known chemical-reaction mechanisms and observations of field experts. Thus, the proposed method can provide technical support for the predictive control and optimization of such systems. |
format | Online Article Text |
id | pubmed-10099443 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | American Chemical Society |
record_format | MEDLINE/PubMed |
spelling | pubmed-100994432023-04-14 A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction Wu, Xiuliang Sun, Kai Cao, Maoyong ACS Omega [Image: see text] The data collected from complex process industries are usually time series with considerable nonlinearities and dynamics, as well as excessive redundancy. Moreover, there are temporal and spatial correlations between input variables and key performance variables. These characteristics bring great difficulties to data-driven modeling of the key performance variables. To overcome the problems, a new regularized spatiotemporal attention (STA)-based long short-term memory (LSTM) was developed. First, a standard LSTM network with an STA module was trained to capture the dynamic relationship between input and target variables. Second, the least absolute shrinkage and selection operator was introduced to optimize the STA module. Third, the hyperparameter representing the regularization strength of the algorithm was determined using a moving window cross-validation strategy. Finally, the proposed algorithm was compared to other state-of-the-art algorithms using artificial data, and then it was used to predict the nitrogen oxide emissions of a selective catalytic reduction denitration system. Simulation results showed that the proposed algorithm achieved more accurate predictions than the other algorithms. Furthermore, the statistics and analysis of the importance of the variables are consistent with known chemical-reaction mechanisms and observations of field experts. Thus, the proposed method can provide technical support for the predictive control and optimization of such systems. American Chemical Society 2023-03-30 /pmc/articles/PMC10099443/ /pubmed/37065070 http://dx.doi.org/10.1021/acsomega.2c08205 Text en © 2023 The Authors. Published by American Chemical Society https://creativecommons.org/licenses/by-nc-nd/4.0/Permits non-commercial access and re-use, provided that author attribution and integrity are maintained; but does not permit creation of adaptations or other derivative works (https://creativecommons.org/licenses/by-nc-nd/4.0/). |
spellingShingle | Wu, Xiuliang Sun, Kai Cao, Maoyong A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction |
title | A New Regularized Spatiotemporal Attention-Based
LSTM with Application to Nitrogen Oxides Emission Prediction |
title_full | A New Regularized Spatiotemporal Attention-Based
LSTM with Application to Nitrogen Oxides Emission Prediction |
title_fullStr | A New Regularized Spatiotemporal Attention-Based
LSTM with Application to Nitrogen Oxides Emission Prediction |
title_full_unstemmed | A New Regularized Spatiotemporal Attention-Based
LSTM with Application to Nitrogen Oxides Emission Prediction |
title_short | A New Regularized Spatiotemporal Attention-Based
LSTM with Application to Nitrogen Oxides Emission Prediction |
title_sort | new regularized spatiotemporal attention-based
lstm with application to nitrogen oxides emission prediction |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10099443/ https://www.ncbi.nlm.nih.gov/pubmed/37065070 http://dx.doi.org/10.1021/acsomega.2c08205 |
work_keys_str_mv | AT wuxiuliang anewregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction AT sunkai anewregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction AT caomaoyong anewregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction AT wuxiuliang newregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction AT sunkai newregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction AT caomaoyong newregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction |