Cargando…

A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics

With the development of deep learning, researchers design deep network structures in order to extract rich high-level semantic information. Nowadays, most popular algorithms are designed based on the complexity of visible image features. However, compared with visible image features, infrared image...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Wenli, Wang, Ning, Chen, Kaizhen, Liu, Yuxin, Zhao, Tingsong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914711/
https://www.ncbi.nlm.nih.gov/pubmed/35271168
http://dx.doi.org/10.3390/s22052022
_version_ 1784667791632105472
author Zhang, Wenli
Wang, Ning
Chen, Kaizhen
Liu, Yuxin
Zhao, Tingsong
author_facet Zhang, Wenli
Wang, Ning
Chen, Kaizhen
Liu, Yuxin
Zhao, Tingsong
author_sort Zhang, Wenli
collection PubMed
description With the development of deep learning, researchers design deep network structures in order to extract rich high-level semantic information. Nowadays, most popular algorithms are designed based on the complexity of visible image features. However, compared with visible image features, infrared image features are more homogeneous, and the application of deep networks is prone to extracting redundant features. Therefore, it is important to prune the network layers where redundant features are extracted. Therefore, this paper proposes a pruning method for deep convolutional network based on heat map generation metrics. The ‘network layer performance evaluation metrics’ are obtained from the number of pixel activations in the heat map. The network layer with the lowest ‘network layer performance evaluation metrics’ is pruned. To address the problem that the simultaneous deletion of multiple structures may result in incorrect pruning, the Alternating training and self-pruning strategy is proposed. Using a cyclic process of pruning each model once and retraining the pruned model to reduce the incorrect pruning of network layers. The experimental results show that proposed method in this paper improved the performance of CSPDarknet, Darknet and Resnet.
format Online
Article
Text
id pubmed-8914711
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-89147112022-03-12 A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics Zhang, Wenli Wang, Ning Chen, Kaizhen Liu, Yuxin Zhao, Tingsong Sensors (Basel) Article With the development of deep learning, researchers design deep network structures in order to extract rich high-level semantic information. Nowadays, most popular algorithms are designed based on the complexity of visible image features. However, compared with visible image features, infrared image features are more homogeneous, and the application of deep networks is prone to extracting redundant features. Therefore, it is important to prune the network layers where redundant features are extracted. Therefore, this paper proposes a pruning method for deep convolutional network based on heat map generation metrics. The ‘network layer performance evaluation metrics’ are obtained from the number of pixel activations in the heat map. The network layer with the lowest ‘network layer performance evaluation metrics’ is pruned. To address the problem that the simultaneous deletion of multiple structures may result in incorrect pruning, the Alternating training and self-pruning strategy is proposed. Using a cyclic process of pruning each model once and retraining the pruned model to reduce the incorrect pruning of network layers. The experimental results show that proposed method in this paper improved the performance of CSPDarknet, Darknet and Resnet. MDPI 2022-03-04 /pmc/articles/PMC8914711/ /pubmed/35271168 http://dx.doi.org/10.3390/s22052022 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhang, Wenli
Wang, Ning
Chen, Kaizhen
Liu, Yuxin
Zhao, Tingsong
A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics
title A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics
title_full A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics
title_fullStr A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics
title_full_unstemmed A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics
title_short A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics
title_sort pruning method for deep convolutional network based on heat map generation metrics
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914711/
https://www.ncbi.nlm.nih.gov/pubmed/35271168
http://dx.doi.org/10.3390/s22052022
work_keys_str_mv AT zhangwenli apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics
AT wangning apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics
AT chenkaizhen apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics
AT liuyuxin apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics
AT zhaotingsong apruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics
AT zhangwenli pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics
AT wangning pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics
AT chenkaizhen pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics
AT liuyuxin pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics
AT zhaotingsong pruningmethodfordeepconvolutionalnetworkbasedonheatmapgenerationmetrics