Cargando…

Deep Learning for Operating Performance Assessment of Industrial Processes with Layer Attention-Based Stacked Performance-Relevant Denoising Auto-Encoders

[Image: see text] The operating performance of a process may degenerate due to process interferences and operation errors, which cancel the benefits of technology design and economic production. Traditional operating performance assessment methods are either lack of real-time due to the post-analysi...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Yan, Ma, Zhe, Wang, Fuli
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Chemical Society 2023
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10134231/
https://www.ncbi.nlm.nih.gov/pubmed/37125105
http://dx.doi.org/10.1021/acsomega.3c00414
_version_ 1785031715985555456
author Liu, Yan
Ma, Zhe
Wang, Fuli
author_facet Liu, Yan
Ma, Zhe
Wang, Fuli
author_sort Liu, Yan
collection PubMed
description [Image: see text] The operating performance of a process may degenerate due to process interferences and operation errors, which cancel the benefits of technology design and economic production. Traditional operating performance assessment methods are either lack of real-time due to the post-analysis or difficult to distinguish performance grades for process data with weak differences and strong noise interferences based on shallow learning structures. In this paper, a new layer attention-based stacked performance-relevant denoising auto-encoder (LA-SPDAE) is proposed for the operating performance assessment of industrial processes. It overcomes the defect that the original SDAE ignores task-relevant information in training and only uses the feature of the last hidden layer to complete special tasks. In this study, the original SDAE is improved by optimizing the cross-entropy loss of the performance grade labels in the layer-wise pretraining, which is named stacked performance-relevant denoising auto-encoder (SPDAE), and the performance-relevant features can be extracted under supervision. Moreover, for making good use of performance-relevant features of each layer, they are fused by adaptive weights based on the layer attention mechanism. In the case study of cyanide leaching, the assessment accuracy of the proposed LA-SPDAE model is up to 99.85% under the corrupted proportion of 20%, and the advantage is still maintained as the proportion increases to 80%, which demonstrates the superiority of LA-SPDAE compared with conventional deep neural networks and shallow learning structures.
format Online
Article
Text
id pubmed-10134231
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher American Chemical Society
record_format MEDLINE/PubMed
spelling pubmed-101342312023-04-28 Deep Learning for Operating Performance Assessment of Industrial Processes with Layer Attention-Based Stacked Performance-Relevant Denoising Auto-Encoders Liu, Yan Ma, Zhe Wang, Fuli ACS Omega [Image: see text] The operating performance of a process may degenerate due to process interferences and operation errors, which cancel the benefits of technology design and economic production. Traditional operating performance assessment methods are either lack of real-time due to the post-analysis or difficult to distinguish performance grades for process data with weak differences and strong noise interferences based on shallow learning structures. In this paper, a new layer attention-based stacked performance-relevant denoising auto-encoder (LA-SPDAE) is proposed for the operating performance assessment of industrial processes. It overcomes the defect that the original SDAE ignores task-relevant information in training and only uses the feature of the last hidden layer to complete special tasks. In this study, the original SDAE is improved by optimizing the cross-entropy loss of the performance grade labels in the layer-wise pretraining, which is named stacked performance-relevant denoising auto-encoder (SPDAE), and the performance-relevant features can be extracted under supervision. Moreover, for making good use of performance-relevant features of each layer, they are fused by adaptive weights based on the layer attention mechanism. In the case study of cyanide leaching, the assessment accuracy of the proposed LA-SPDAE model is up to 99.85% under the corrupted proportion of 20%, and the advantage is still maintained as the proportion increases to 80%, which demonstrates the superiority of LA-SPDAE compared with conventional deep neural networks and shallow learning structures. American Chemical Society 2023-04-10 /pmc/articles/PMC10134231/ /pubmed/37125105 http://dx.doi.org/10.1021/acsomega.3c00414 Text en © 2023 The Authors. Published by American Chemical Society https://creativecommons.org/licenses/by-nc-nd/4.0/Permits non-commercial access and re-use, provided that author attribution and integrity are maintained; but does not permit creation of adaptations or other derivative works (https://creativecommons.org/licenses/by-nc-nd/4.0/).
spellingShingle Liu, Yan
Ma, Zhe
Wang, Fuli
Deep Learning for Operating Performance Assessment of Industrial Processes with Layer Attention-Based Stacked Performance-Relevant Denoising Auto-Encoders
title Deep Learning for Operating Performance Assessment of Industrial Processes with Layer Attention-Based Stacked Performance-Relevant Denoising Auto-Encoders
title_full Deep Learning for Operating Performance Assessment of Industrial Processes with Layer Attention-Based Stacked Performance-Relevant Denoising Auto-Encoders
title_fullStr Deep Learning for Operating Performance Assessment of Industrial Processes with Layer Attention-Based Stacked Performance-Relevant Denoising Auto-Encoders
title_full_unstemmed Deep Learning for Operating Performance Assessment of Industrial Processes with Layer Attention-Based Stacked Performance-Relevant Denoising Auto-Encoders
title_short Deep Learning for Operating Performance Assessment of Industrial Processes with Layer Attention-Based Stacked Performance-Relevant Denoising Auto-Encoders
title_sort deep learning for operating performance assessment of industrial processes with layer attention-based stacked performance-relevant denoising auto-encoders
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10134231/
https://www.ncbi.nlm.nih.gov/pubmed/37125105
http://dx.doi.org/10.1021/acsomega.3c00414
work_keys_str_mv AT liuyan deeplearningforoperatingperformanceassessmentofindustrialprocesseswithlayerattentionbasedstackedperformancerelevantdenoisingautoencoders
AT mazhe deeplearningforoperatingperformanceassessmentofindustrialprocesseswithlayerattentionbasedstackedperformancerelevantdenoisingautoencoders
AT wangfuli deeplearningforoperatingperformanceassessmentofindustrialprocesseswithlayerattentionbasedstackedperformancerelevantdenoisingautoencoders