Cargando…

A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction

[Image: see text] The data collected from complex process industries are usually time series with considerable nonlinearities and dynamics, as well as excessive redundancy. Moreover, there are temporal and spatial correlations between input variables and key performance variables. These characterist...

Descripción completa

Detalles Bibliográficos
Autores principales: Wu, Xiuliang, Sun, Kai, Cao, Maoyong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Chemical Society 2023
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10099443/
https://www.ncbi.nlm.nih.gov/pubmed/37065070
http://dx.doi.org/10.1021/acsomega.2c08205
_version_ 1785025054184046592
author Wu, Xiuliang
Sun, Kai
Cao, Maoyong
author_facet Wu, Xiuliang
Sun, Kai
Cao, Maoyong
author_sort Wu, Xiuliang
collection PubMed
description [Image: see text] The data collected from complex process industries are usually time series with considerable nonlinearities and dynamics, as well as excessive redundancy. Moreover, there are temporal and spatial correlations between input variables and key performance variables. These characteristics bring great difficulties to data-driven modeling of the key performance variables. To overcome the problems, a new regularized spatiotemporal attention (STA)-based long short-term memory (LSTM) was developed. First, a standard LSTM network with an STA module was trained to capture the dynamic relationship between input and target variables. Second, the least absolute shrinkage and selection operator was introduced to optimize the STA module. Third, the hyperparameter representing the regularization strength of the algorithm was determined using a moving window cross-validation strategy. Finally, the proposed algorithm was compared to other state-of-the-art algorithms using artificial data, and then it was used to predict the nitrogen oxide emissions of a selective catalytic reduction denitration system. Simulation results showed that the proposed algorithm achieved more accurate predictions than the other algorithms. Furthermore, the statistics and analysis of the importance of the variables are consistent with known chemical-reaction mechanisms and observations of field experts. Thus, the proposed method can provide technical support for the predictive control and optimization of such systems.
format Online
Article
Text
id pubmed-10099443
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher American Chemical Society
record_format MEDLINE/PubMed
spelling pubmed-100994432023-04-14 A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction Wu, Xiuliang Sun, Kai Cao, Maoyong ACS Omega [Image: see text] The data collected from complex process industries are usually time series with considerable nonlinearities and dynamics, as well as excessive redundancy. Moreover, there are temporal and spatial correlations between input variables and key performance variables. These characteristics bring great difficulties to data-driven modeling of the key performance variables. To overcome the problems, a new regularized spatiotemporal attention (STA)-based long short-term memory (LSTM) was developed. First, a standard LSTM network with an STA module was trained to capture the dynamic relationship between input and target variables. Second, the least absolute shrinkage and selection operator was introduced to optimize the STA module. Third, the hyperparameter representing the regularization strength of the algorithm was determined using a moving window cross-validation strategy. Finally, the proposed algorithm was compared to other state-of-the-art algorithms using artificial data, and then it was used to predict the nitrogen oxide emissions of a selective catalytic reduction denitration system. Simulation results showed that the proposed algorithm achieved more accurate predictions than the other algorithms. Furthermore, the statistics and analysis of the importance of the variables are consistent with known chemical-reaction mechanisms and observations of field experts. Thus, the proposed method can provide technical support for the predictive control and optimization of such systems. American Chemical Society 2023-03-30 /pmc/articles/PMC10099443/ /pubmed/37065070 http://dx.doi.org/10.1021/acsomega.2c08205 Text en © 2023 The Authors. Published by American Chemical Society https://creativecommons.org/licenses/by-nc-nd/4.0/Permits non-commercial access and re-use, provided that author attribution and integrity are maintained; but does not permit creation of adaptations or other derivative works (https://creativecommons.org/licenses/by-nc-nd/4.0/).
spellingShingle Wu, Xiuliang
Sun, Kai
Cao, Maoyong
A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction
title A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction
title_full A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction
title_fullStr A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction
title_full_unstemmed A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction
title_short A New Regularized Spatiotemporal Attention-Based LSTM with Application to Nitrogen Oxides Emission Prediction
title_sort new regularized spatiotemporal attention-based lstm with application to nitrogen oxides emission prediction
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10099443/
https://www.ncbi.nlm.nih.gov/pubmed/37065070
http://dx.doi.org/10.1021/acsomega.2c08205
work_keys_str_mv AT wuxiuliang anewregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction
AT sunkai anewregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction
AT caomaoyong anewregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction
AT wuxiuliang newregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction
AT sunkai newregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction
AT caomaoyong newregularizedspatiotemporalattentionbasedlstmwithapplicationtonitrogenoxidesemissionprediction