Cargando…

Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB–D Multi-Camera Dataset

Latest advances of deep learning paradigm and 3D imaging systems have raised the necessity for more complete datasets that allow exploitation of facial features such as pose, gender or age. In our work, we propose a new facial dataset collected with an innovative RGB–D multi-camera setup whose optim...

Descripción completa

Detalles Bibliográficos
Autores principales: Quintana, Marcos, Karaoglu, Sezer, Alvarez, Federico, Menendez, Jose Manuel, Gevers, Theo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6427725/
https://www.ncbi.nlm.nih.gov/pubmed/30836714
http://dx.doi.org/10.3390/s19051103
_version_ 1783405276571893760
author Quintana, Marcos
Karaoglu, Sezer
Alvarez, Federico
Menendez, Jose Manuel
Gevers, Theo
author_facet Quintana, Marcos
Karaoglu, Sezer
Alvarez, Federico
Menendez, Jose Manuel
Gevers, Theo
author_sort Quintana, Marcos
collection PubMed
description Latest advances of deep learning paradigm and 3D imaging systems have raised the necessity for more complete datasets that allow exploitation of facial features such as pose, gender or age. In our work, we propose a new facial dataset collected with an innovative RGB–D multi-camera setup whose optimization is presented and validated. 3DWF includes 3D raw and registered data collection for 92 persons from low-cost RGB–D sensing devices to commercial scanners with great accuracy. 3DWF provides a complete dataset with relevant and accurate visual information for different tasks related to facial properties such as face tracking or 3D face reconstruction by means of annotated density normalized 2K clouds and RGB–D streams. In addition, we validate the reliability of our proposal by an original data augmentation method from a massive set of face meshes for facial landmark detection in 2D domain, and by head pose classification through common Machine Learning techniques directed towards proving alignment of collected data.
format Online
Article
Text
id pubmed-6427725
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-64277252019-04-15 Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB–D Multi-Camera Dataset Quintana, Marcos Karaoglu, Sezer Alvarez, Federico Menendez, Jose Manuel Gevers, Theo Sensors (Basel) Article Latest advances of deep learning paradigm and 3D imaging systems have raised the necessity for more complete datasets that allow exploitation of facial features such as pose, gender or age. In our work, we propose a new facial dataset collected with an innovative RGB–D multi-camera setup whose optimization is presented and validated. 3DWF includes 3D raw and registered data collection for 92 persons from low-cost RGB–D sensing devices to commercial scanners with great accuracy. 3DWF provides a complete dataset with relevant and accurate visual information for different tasks related to facial properties such as face tracking or 3D face reconstruction by means of annotated density normalized 2K clouds and RGB–D streams. In addition, we validate the reliability of our proposal by an original data augmentation method from a massive set of face meshes for facial landmark detection in 2D domain, and by head pose classification through common Machine Learning techniques directed towards proving alignment of collected data. MDPI 2019-03-04 /pmc/articles/PMC6427725/ /pubmed/30836714 http://dx.doi.org/10.3390/s19051103 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Quintana, Marcos
Karaoglu, Sezer
Alvarez, Federico
Menendez, Jose Manuel
Gevers, Theo
Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB–D Multi-Camera Dataset
title Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB–D Multi-Camera Dataset
title_full Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB–D Multi-Camera Dataset
title_fullStr Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB–D Multi-Camera Dataset
title_full_unstemmed Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB–D Multi-Camera Dataset
title_short Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB–D Multi-Camera Dataset
title_sort three-d wide faces (3dwf): facial landmark detection and 3d reconstruction over a new rgb–d multi-camera dataset
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6427725/
https://www.ncbi.nlm.nih.gov/pubmed/30836714
http://dx.doi.org/10.3390/s19051103
work_keys_str_mv AT quintanamarcos threedwidefaces3dwffaciallandmarkdetectionand3dreconstructionoveranewrgbdmulticameradataset
AT karaoglusezer threedwidefaces3dwffaciallandmarkdetectionand3dreconstructionoveranewrgbdmulticameradataset
AT alvarezfederico threedwidefaces3dwffaciallandmarkdetectionand3dreconstructionoveranewrgbdmulticameradataset
AT menendezjosemanuel threedwidefaces3dwffaciallandmarkdetectionand3dreconstructionoveranewrgbdmulticameradataset
AT geverstheo threedwidefaces3dwffaciallandmarkdetectionand3dreconstructionoveranewrgbdmulticameradataset