Cargando…
A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics
With the development of deep learning, researchers design deep network structures in order to extract rich high-level semantic information. Nowadays, most popular algorithms are designed based on the complexity of visible image features. However, compared with visible image features, infrared image...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914711/ https://www.ncbi.nlm.nih.gov/pubmed/35271168 http://dx.doi.org/10.3390/s22052022 |
_version_ | 1784667791632105472 |
---|---|
author | Zhang, Wenli Wang, Ning Chen, Kaizhen Liu, Yuxin Zhao, Tingsong |
author_facet | Zhang, Wenli Wang, Ning Chen, Kaizhen Liu, Yuxin Zhao, Tingsong |
author_sort | Zhang, Wenli |
collection | PubMed |
description | With the development of deep learning, researchers design deep network structures in order to extract rich high-level semantic information. Nowadays, most popular algorithms are designed based on the complexity of visible image features. However, compared with visible image features, infrared image features are more homogeneous, and the application of deep networks is prone to extracting redundant features. Therefore, it is important to prune the network layers where redundant features are extracted. Therefore, this paper proposes a pruning method for deep convolutional network based on heat map generation metrics. The ‘network layer performance evaluation metrics’ are obtained from the number of pixel activations in the heat map. The network layer with the lowest ‘network layer performance evaluation metrics’ is pruned. To address the problem that the simultaneous deletion of multiple structures may result in incorrect pruning, the Alternating training and self-pruning strategy is proposed. Using a cyclic process of pruning each model once and retraining the pruned model to reduce the incorrect pruning of network layers. The experimental results show that proposed method in this paper improved the performance of CSPDarknet, Darknet and Resnet. |
format | Online Article Text |
id | pubmed-8914711 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-89147112022-03-12 A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics Zhang, Wenli Wang, Ning Chen, Kaizhen Liu, Yuxin Zhao, Tingsong Sensors (Basel) Article With the development of deep learning, researchers design deep network structures in order to extract rich high-level semantic information. Nowadays, most popular algorithms are designed based on the complexity of visible image features. However, compared with visible image features, infrared image features are more homogeneous, and the application of deep networks is prone to extracting redundant features. Therefore, it is important to prune the network layers where redundant features are extracted. Therefore, this paper proposes a pruning method for deep convolutional network based on heat map generation metrics. The ‘network layer performance evaluation metrics’ are obtained from the number of pixel activations in the heat map. The network layer with the lowest ‘network layer performance evaluation metrics’ is pruned. To address the problem that the simultaneous deletion of multiple structures may result in incorrect pruning, the Alternating training and self-pruning strategy is proposed. Using a cyclic process of pruning each model once and retraining the pruned model to reduce the incorrect pruning of network layers. The experimental results show that proposed method in this paper improved the performance of CSPDarknet, Darknet and Resnet. MDPI 2022-03-04 /pmc/articles/PMC8914711/ /pubmed/35271168 http://dx.doi.org/10.3390/s22052022 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhang, Wenli Wang, Ning Chen, Kaizhen Liu, Yuxin Zhao, Tingsong A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics |
title | A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics |
title_full | A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics |
title_fullStr | A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics |
title_full_unstemmed | A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics |
title_short | A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics |
title_sort | pruning method for deep convolutional network based on heat map generation metrics |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914711/ https://www.ncbi.nlm.nih.gov/pubmed/35271168 http://dx.doi.org/10.3390/s22052022 |
work_keys_str_mv | AT zhangwenli apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics AT wangning apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics AT chenkaizhen apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics AT liuyuxin apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics AT zhaotingsong apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics AT zhangwenli pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics AT wangning pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics AT chenkaizhen pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics AT liuyuxin pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics AT zhaotingsong pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics |