Cargando…

Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN

High-efficiency video coding (HEVC/H.265) is one of the most widely used video coding standards. HEVC introduces a quad-tree coding unit (CU) partition structure to improve video compression efficiency. The determination of the optimal CU partition is achieved through the brute-force search rate-dis...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Ting, Wei, Geng, Li, Huayu, Bui, ThiOanh, Zeng, Qian, Wang, Ruliang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10535392/
https://www.ncbi.nlm.nih.gov/pubmed/37765979
http://dx.doi.org/10.3390/s23187923
_version_ 1785112618799726592
author Wang, Ting
Wei, Geng
Li, Huayu
Bui, ThiOanh
Zeng, Qian
Wang, Ruliang
author_facet Wang, Ting
Wei, Geng
Li, Huayu
Bui, ThiOanh
Zeng, Qian
Wang, Ruliang
author_sort Wang, Ting
collection PubMed
description High-efficiency video coding (HEVC/H.265) is one of the most widely used video coding standards. HEVC introduces a quad-tree coding unit (CU) partition structure to improve video compression efficiency. The determination of the optimal CU partition is achieved through the brute-force search rate-distortion optimization method, which may result in high encoding complexity and hardware implementation challenges. To address this problem, this paper proposes a method that combines convolutional neural networks (CNN) with joint texture recognition to reduce encoding complexity. First, a classification decision method based on the global and local texture features of the CU is proposed, efficiently dividing the CU into smooth and complex texture regions. Second, for the CUs in smooth texture regions, the partition is determined by terminating early. For the CUs in complex texture regions, a proposed CNN is used for predictive partitioning, thus avoiding the traditional recursive approach. Finally, combined with texture classification, the proposed CNN achieves a good balance between the coding complexity and the coding performance. The experimental results demonstrate that the proposed algorithm reduces computational complexity by 61.23%, while only increasing BD-BR by 1.86% and decreasing BD-PSNR by just 0.09 dB.
format Online
Article
Text
id pubmed-10535392
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-105353922023-09-29 Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN Wang, Ting Wei, Geng Li, Huayu Bui, ThiOanh Zeng, Qian Wang, Ruliang Sensors (Basel) Article High-efficiency video coding (HEVC/H.265) is one of the most widely used video coding standards. HEVC introduces a quad-tree coding unit (CU) partition structure to improve video compression efficiency. The determination of the optimal CU partition is achieved through the brute-force search rate-distortion optimization method, which may result in high encoding complexity and hardware implementation challenges. To address this problem, this paper proposes a method that combines convolutional neural networks (CNN) with joint texture recognition to reduce encoding complexity. First, a classification decision method based on the global and local texture features of the CU is proposed, efficiently dividing the CU into smooth and complex texture regions. Second, for the CUs in smooth texture regions, the partition is determined by terminating early. For the CUs in complex texture regions, a proposed CNN is used for predictive partitioning, thus avoiding the traditional recursive approach. Finally, combined with texture classification, the proposed CNN achieves a good balance between the coding complexity and the coding performance. The experimental results demonstrate that the proposed algorithm reduces computational complexity by 61.23%, while only increasing BD-BR by 1.86% and decreasing BD-PSNR by just 0.09 dB. MDPI 2023-09-15 /pmc/articles/PMC10535392/ /pubmed/37765979 http://dx.doi.org/10.3390/s23187923 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Ting
Wei, Geng
Li, Huayu
Bui, ThiOanh
Zeng, Qian
Wang, Ruliang
Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN
title Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN
title_full Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN
title_fullStr Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN
title_full_unstemmed Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN
title_short Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN
title_sort fast cu partition algorithm for intra frame coding based on joint texture classification and cnn
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10535392/
https://www.ncbi.nlm.nih.gov/pubmed/37765979
http://dx.doi.org/10.3390/s23187923
work_keys_str_mv AT wangting fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn
AT weigeng fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn
AT lihuayu fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn
AT buithioanh fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn
AT zengqian fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn
AT wangruliang fastcupartitionalgorithmforintraframecodingbasedonjointtextureclassificationandcnn