Cargando…
Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN
High-efficiency video coding (HEVC/H.265) is one of the most widely used video coding standards. HEVC introduces a quad-tree coding unit (CU) partition structure to improve video compression efficiency. The determination of the optimal CU partition is achieved through the brute-force search rate-dis...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10535392/ https://www.ncbi.nlm.nih.gov/pubmed/37765979 http://dx.doi.org/10.3390/s23187923 |
_version_ | 1785112618799726592 |
---|---|
author | Wang, Ting Wei, Geng Li, Huayu Bui, ThiOanh Zeng, Qian Wang, Ruliang |
author_facet | Wang, Ting Wei, Geng Li, Huayu Bui, ThiOanh Zeng, Qian Wang, Ruliang |
author_sort | Wang, Ting |
collection | PubMed |
description | High-efficiency video coding (HEVC/H.265) is one of the most widely used video coding standards. HEVC introduces a quad-tree coding unit (CU) partition structure to improve video compression efficiency. The determination of the optimal CU partition is achieved through the brute-force search rate-distortion optimization method, which may result in high encoding complexity and hardware implementation challenges. To address this problem, this paper proposes a method that combines convolutional neural networks (CNN) with joint texture recognition to reduce encoding complexity. First, a classification decision method based on the global and local texture features of the CU is proposed, efficiently dividing the CU into smooth and complex texture regions. Second, for the CUs in smooth texture regions, the partition is determined by terminating early. For the CUs in complex texture regions, a proposed CNN is used for predictive partitioning, thus avoiding the traditional recursive approach. Finally, combined with texture classification, the proposed CNN achieves a good balance between the coding complexity and the coding performance. The experimental results demonstrate that the proposed algorithm reduces computational complexity by 61.23%, while only increasing BD-BR by 1.86% and decreasing BD-PSNR by just 0.09 dB. |
format | Online Article Text |
id | pubmed-10535392 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-105353922023-09-29 Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN Wang, Ting Wei, Geng Li, Huayu Bui, ThiOanh Zeng, Qian Wang, Ruliang Sensors (Basel) Article High-efficiency video coding (HEVC/H.265) is one of the most widely used video coding standards. HEVC introduces a quad-tree coding unit (CU) partition structure to improve video compression efficiency. The determination of the optimal CU partition is achieved through the brute-force search rate-distortion optimization method, which may result in high encoding complexity and hardware implementation challenges. To address this problem, this paper proposes a method that combines convolutional neural networks (CNN) with joint texture recognition to reduce encoding complexity. First, a classification decision method based on the global and local texture features of the CU is proposed, efficiently dividing the CU into smooth and complex texture regions. Second, for the CUs in smooth texture regions, the partition is determined by terminating early. For the CUs in complex texture regions, a proposed CNN is used for predictive partitioning, thus avoiding the traditional recursive approach. Finally, combined with texture classification, the proposed CNN achieves a good balance between the coding complexity and the coding performance. The experimental results demonstrate that the proposed algorithm reduces computational complexity by 61.23%, while only increasing BD-BR by 1.86% and decreasing BD-PSNR by just 0.09 dB. MDPI 2023-09-15 /pmc/articles/PMC10535392/ /pubmed/37765979 http://dx.doi.org/10.3390/s23187923 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Wang, Ting Wei, Geng Li, Huayu Bui, ThiOanh Zeng, Qian Wang, Ruliang Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN |
title | Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN |
title_full | Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN |
title_fullStr | Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN |
title_full_unstemmed | Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN |
title_short | Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN |
title_sort | fast cu partition algorithm for intra frame coding based on joint texture classification and cnn |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10535392/ https://www.ncbi.nlm.nih.gov/pubmed/37765979 http://dx.doi.org/10.3390/s23187923 |
work_keys_str_mv | AT wangting fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn AT weigeng fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn AT lihuayu fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn AT buithioanh fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn AT zengqian fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn AT wangruliang fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn |