Cargando…
Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling
Multiview video plus depth is a popular 3D video format which can provide viewers a vivid 3D feeling. However, its requirements in terms of computational complexity and transmission bandwidth are more than that of conventional 2D video. To mitigate these limitations, some works have proposed to redu...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer International Publishing
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4851693/ https://www.ncbi.nlm.nih.gov/pubmed/27231481 http://dx.doi.org/10.1186/s13640-016-0119-4 |
_version_ | 1782429845623406592 |
---|---|
author | Jin, Zhi Tillo, Tammam Xiao, Jimin Zhao, Yao |
author_facet | Jin, Zhi Tillo, Tammam Xiao, Jimin Zhao, Yao |
author_sort | Jin, Zhi |
collection | PubMed |
description | Multiview video plus depth is a popular 3D video format which can provide viewers a vivid 3D feeling. However, its requirements in terms of computational complexity and transmission bandwidth are more than that of conventional 2D video. To mitigate these limitations, some works have proposed to reduce the amount of transmitted data by adopting different resolutions for different views, and consequently, the transmitted video is called mixed resolution video. In order to further reduce the transmitted data and maintain good quality at the decoder side; in this paper, we propose a down/upsampling algorithm for 3D multiview video which systematically takes into account the video encoder and decoder. At the encoder side, the rows of the two adjacent views are downsampled following an interlacing and complementary fashion, whereas, at the decoder side, the discarded pixels are recovered by fusing the virtual view pixels with the directional interpolated pixels from the complementary downsampled views. Moreover, the patterns of the texture surrounding the discarded pixels are used to aid the data fusion, so as to enhance edges recovery. Meanwhile, with the assistance of virtual views, at the decoder side, the proposed approach can effectively recover the discarded high-frequency details. The experimental results demonstrate the superior performance of the proposed framework. |
format | Online Article Text |
id | pubmed-4851693 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Springer International Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-48516932016-05-24 Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling Jin, Zhi Tillo, Tammam Xiao, Jimin Zhao, Yao EURASIP J Image Video Process Research Multiview video plus depth is a popular 3D video format which can provide viewers a vivid 3D feeling. However, its requirements in terms of computational complexity and transmission bandwidth are more than that of conventional 2D video. To mitigate these limitations, some works have proposed to reduce the amount of transmitted data by adopting different resolutions for different views, and consequently, the transmitted video is called mixed resolution video. In order to further reduce the transmitted data and maintain good quality at the decoder side; in this paper, we propose a down/upsampling algorithm for 3D multiview video which systematically takes into account the video encoder and decoder. At the encoder side, the rows of the two adjacent views are downsampled following an interlacing and complementary fashion, whereas, at the decoder side, the discarded pixels are recovered by fusing the virtual view pixels with the directional interpolated pixels from the complementary downsampled views. Moreover, the patterns of the texture surrounding the discarded pixels are used to aid the data fusion, so as to enhance edges recovery. Meanwhile, with the assistance of virtual views, at the decoder side, the proposed approach can effectively recover the discarded high-frequency details. The experimental results demonstrate the superior performance of the proposed framework. Springer International Publishing 2016-04-29 2016 /pmc/articles/PMC4851693/ /pubmed/27231481 http://dx.doi.org/10.1186/s13640-016-0119-4 Text en © Jin et al. 2016 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
spellingShingle | Research Jin, Zhi Tillo, Tammam Xiao, Jimin Zhao, Yao Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling |
title | Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling |
title_full | Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling |
title_fullStr | Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling |
title_full_unstemmed | Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling |
title_short | Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling |
title_sort | multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4851693/ https://www.ncbi.nlm.nih.gov/pubmed/27231481 http://dx.doi.org/10.1186/s13640-016-0119-4 |
work_keys_str_mv | AT jinzhi multiviewvideoplusdepthtransmissionviavirtualviewassistedcomplementarydownupsampling AT tillotammam multiviewvideoplusdepthtransmissionviavirtualviewassistedcomplementarydownupsampling AT xiaojimin multiviewvideoplusdepthtransmissionviavirtualviewassistedcomplementarydownupsampling AT zhaoyao multiviewvideoplusdepthtransmissionviavirtualviewassistedcomplementarydownupsampling |