Cargando…

A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps

In this paper, we propose a novel 2D-to-3D video conversion method for 3D entertainment applications. 3D entertainment is getting more and more popular and can be found in many contexts, such as TV and home gaming equipment. 3D image sensors are a new method to produce stereoscopic video content con...

Descripción completa

Detalles Bibliográficos
Autores principales: Yin, Shouyi, Dong, Hao, Jiang, Guangli, Liu, Leibo, Wei, Shaojun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2015
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4541829/
https://www.ncbi.nlm.nih.gov/pubmed/26131674
http://dx.doi.org/10.3390/s150715246
_version_ 1782386442426646528
author Yin, Shouyi
Dong, Hao
Jiang, Guangli
Liu, Leibo
Wei, Shaojun
author_facet Yin, Shouyi
Dong, Hao
Jiang, Guangli
Liu, Leibo
Wei, Shaojun
author_sort Yin, Shouyi
collection PubMed
description In this paper, we propose a novel 2D-to-3D video conversion method for 3D entertainment applications. 3D entertainment is getting more and more popular and can be found in many contexts, such as TV and home gaming equipment. 3D image sensors are a new method to produce stereoscopic video content conveniently and at a low cost, and can thus meet the urgent demand for 3D videos in the 3D entertaiment market. Generally, 2D image sensor and 2D-to-3D conversion chip can compose a 3D image sensor. Our study presents a novel 2D-to-3D video conversion algorithm which can be adopted in a 3D image sensor. In our algorithm, a depth map is generated by combining global depth gradient and local depth refinement for each frame of 2D video input. Global depth gradient is computed according to image type while local depth refinement is related to color information. As input 2D video content consists of a number of video shots, the proposed algorithm reuses the global depth gradient of frames within the same video shot to generate time-coherent depth maps. The experimental results prove that this novel method can adapt to different image types, reduce computational complexity and improve the temporal smoothness of generated 3D video.
format Online
Article
Text
id pubmed-4541829
institution National Center for Biotechnology Information
language English
publishDate 2015
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-45418292015-08-26 A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps Yin, Shouyi Dong, Hao Jiang, Guangli Liu, Leibo Wei, Shaojun Sensors (Basel) Article In this paper, we propose a novel 2D-to-3D video conversion method for 3D entertainment applications. 3D entertainment is getting more and more popular and can be found in many contexts, such as TV and home gaming equipment. 3D image sensors are a new method to produce stereoscopic video content conveniently and at a low cost, and can thus meet the urgent demand for 3D videos in the 3D entertaiment market. Generally, 2D image sensor and 2D-to-3D conversion chip can compose a 3D image sensor. Our study presents a novel 2D-to-3D video conversion algorithm which can be adopted in a 3D image sensor. In our algorithm, a depth map is generated by combining global depth gradient and local depth refinement for each frame of 2D video input. Global depth gradient is computed according to image type while local depth refinement is related to color information. As input 2D video content consists of a number of video shots, the proposed algorithm reuses the global depth gradient of frames within the same video shot to generate time-coherent depth maps. The experimental results prove that this novel method can adapt to different image types, reduce computational complexity and improve the temporal smoothness of generated 3D video. MDPI 2015-06-29 /pmc/articles/PMC4541829/ /pubmed/26131674 http://dx.doi.org/10.3390/s150715246 Text en © 2015 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Yin, Shouyi
Dong, Hao
Jiang, Guangli
Liu, Leibo
Wei, Shaojun
A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps
title A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps
title_full A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps
title_fullStr A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps
title_full_unstemmed A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps
title_short A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps
title_sort novel 2d-to-3d video conversion method using time-coherent depth maps
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4541829/
https://www.ncbi.nlm.nih.gov/pubmed/26131674
http://dx.doi.org/10.3390/s150715246
work_keys_str_mv AT yinshouyi anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps
AT donghao anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps
AT jiangguangli anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps
AT liuleibo anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps
AT weishaojun anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps
AT yinshouyi novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps
AT donghao novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps
AT jiangguangli novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps
AT liuleibo novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps
AT weishaojun novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps