Cargando…

Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling

Multiview video plus depth is a popular 3D video format which can provide viewers a vivid 3D feeling. However, its requirements in terms of computational complexity and transmission bandwidth are more than that of conventional 2D video. To mitigate these limitations, some works have proposed to redu...

Descripción completa

Detalles Bibliográficos
Autores principales: Jin, Zhi, Tillo, Tammam, Xiao, Jimin, Zhao, Yao
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4851693/
https://www.ncbi.nlm.nih.gov/pubmed/27231481
http://dx.doi.org/10.1186/s13640-016-0119-4
_version_ 1782429845623406592
author Jin, Zhi
Tillo, Tammam
Xiao, Jimin
Zhao, Yao
author_facet Jin, Zhi
Tillo, Tammam
Xiao, Jimin
Zhao, Yao
author_sort Jin, Zhi
collection PubMed
description Multiview video plus depth is a popular 3D video format which can provide viewers a vivid 3D feeling. However, its requirements in terms of computational complexity and transmission bandwidth are more than that of conventional 2D video. To mitigate these limitations, some works have proposed to reduce the amount of transmitted data by adopting different resolutions for different views, and consequently, the transmitted video is called mixed resolution video. In order to further reduce the transmitted data and maintain good quality at the decoder side; in this paper, we propose a down/upsampling algorithm for 3D multiview video which systematically takes into account the video encoder and decoder. At the encoder side, the rows of the two adjacent views are downsampled following an interlacing and complementary fashion, whereas, at the decoder side, the discarded pixels are recovered by fusing the virtual view pixels with the directional interpolated pixels from the complementary downsampled views. Moreover, the patterns of the texture surrounding the discarded pixels are used to aid the data fusion, so as to enhance edges recovery. Meanwhile, with the assistance of virtual views, at the decoder side, the proposed approach can effectively recover the discarded high-frequency details. The experimental results demonstrate the superior performance of the proposed framework.
format Online
Article
Text
id pubmed-4851693
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-48516932016-05-24 Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling Jin, Zhi Tillo, Tammam Xiao, Jimin Zhao, Yao EURASIP J Image Video Process Research Multiview video plus depth is a popular 3D video format which can provide viewers a vivid 3D feeling. However, its requirements in terms of computational complexity and transmission bandwidth are more than that of conventional 2D video. To mitigate these limitations, some works have proposed to reduce the amount of transmitted data by adopting different resolutions for different views, and consequently, the transmitted video is called mixed resolution video. In order to further reduce the transmitted data and maintain good quality at the decoder side; in this paper, we propose a down/upsampling algorithm for 3D multiview video which systematically takes into account the video encoder and decoder. At the encoder side, the rows of the two adjacent views are downsampled following an interlacing and complementary fashion, whereas, at the decoder side, the discarded pixels are recovered by fusing the virtual view pixels with the directional interpolated pixels from the complementary downsampled views. Moreover, the patterns of the texture surrounding the discarded pixels are used to aid the data fusion, so as to enhance edges recovery. Meanwhile, with the assistance of virtual views, at the decoder side, the proposed approach can effectively recover the discarded high-frequency details. The experimental results demonstrate the superior performance of the proposed framework. Springer International Publishing 2016-04-29 2016 /pmc/articles/PMC4851693/ /pubmed/27231481 http://dx.doi.org/10.1186/s13640-016-0119-4 Text en © Jin et al. 2016 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
spellingShingle Research
Jin, Zhi
Tillo, Tammam
Xiao, Jimin
Zhao, Yao
Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling
title Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling
title_full Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling
title_fullStr Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling
title_full_unstemmed Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling
title_short Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling
title_sort multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4851693/
https://www.ncbi.nlm.nih.gov/pubmed/27231481
http://dx.doi.org/10.1186/s13640-016-0119-4
work_keys_str_mv AT jinzhi multiviewvideoplusdepthtransmissionviavirtualviewassistedcomplementarydownupsampling
AT tillotammam multiviewvideoplusdepthtransmissionviavirtualviewassistedcomplementarydownupsampling
AT xiaojimin multiviewvideoplusdepthtransmissionviavirtualviewassistedcomplementarydownupsampling
AT zhaoyao multiviewvideoplusdepthtransmissionviavirtualviewassistedcomplementarydownupsampling