Cargando…

Research on the dynamic viseme of the lip shape based on facial motion capture technology

In the study of articulatory phonetics, lip shape and tongue position is the focus of linguists. In order to reveal the physiological characteristics of the lip shape during pronunciation, the author takes the Tibetan Xiahe dialect as the research object and defines the facial parameter feature poin...

Descripción completa

Detalles Bibliográficos
Autor principal: Zhu, Shengyin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9549283/
https://www.ncbi.nlm.nih.gov/pubmed/36225260
http://dx.doi.org/10.3389/fnbot.2022.922756
_version_ 1784805636272291840
author Zhu, Shengyin
author_facet Zhu, Shengyin
author_sort Zhu, Shengyin
collection PubMed
description In the study of articulatory phonetics, lip shape and tongue position is the focus of linguists. In order to reveal the physiological characteristics of the lip shape during pronunciation, the author takes the Tibetan Xiahe dialect as the research object and defines the facial parameter feature points of the speaker according to the MPEG-4 international standard. Most importantly, the author uses the facial motion capture technology to obtain the dynamic lip viseme feature data, during the stop's forming-block, continuing-block, removing-block, and co-articulation with vowels in the CV structure. Through research and analysis, it is found that the distribution of lip shape change the characteristics of different parts' pronunciation is different during the stop's forming block. In the co-articulation with [a], the reverse effect is greater than the forward effect, which is consistent with the relevant conclusions in many languages obtained by many scholars through other experimental methods. The study also found that in the process of pronunciation, the movement of the lip physiological characteristics of each speaker is random to a certain extent, but when different speakers pronounce the same sound, they can always maintain the consistency of the changing trend of the lip shape characteristics.
format Online
Article
Text
id pubmed-9549283
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-95492832022-10-11 Research on the dynamic viseme of the lip shape based on facial motion capture technology Zhu, Shengyin Front Neurorobot Neuroscience In the study of articulatory phonetics, lip shape and tongue position is the focus of linguists. In order to reveal the physiological characteristics of the lip shape during pronunciation, the author takes the Tibetan Xiahe dialect as the research object and defines the facial parameter feature points of the speaker according to the MPEG-4 international standard. Most importantly, the author uses the facial motion capture technology to obtain the dynamic lip viseme feature data, during the stop's forming-block, continuing-block, removing-block, and co-articulation with vowels in the CV structure. Through research and analysis, it is found that the distribution of lip shape change the characteristics of different parts' pronunciation is different during the stop's forming block. In the co-articulation with [a], the reverse effect is greater than the forward effect, which is consistent with the relevant conclusions in many languages obtained by many scholars through other experimental methods. The study also found that in the process of pronunciation, the movement of the lip physiological characteristics of each speaker is random to a certain extent, but when different speakers pronounce the same sound, they can always maintain the consistency of the changing trend of the lip shape characteristics. Frontiers Media S.A. 2022-09-26 /pmc/articles/PMC9549283/ /pubmed/36225260 http://dx.doi.org/10.3389/fnbot.2022.922756 Text en Copyright © 2022 Zhu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Zhu, Shengyin
Research on the dynamic viseme of the lip shape based on facial motion capture technology
title Research on the dynamic viseme of the lip shape based on facial motion capture technology
title_full Research on the dynamic viseme of the lip shape based on facial motion capture technology
title_fullStr Research on the dynamic viseme of the lip shape based on facial motion capture technology
title_full_unstemmed Research on the dynamic viseme of the lip shape based on facial motion capture technology
title_short Research on the dynamic viseme of the lip shape based on facial motion capture technology
title_sort research on the dynamic viseme of the lip shape based on facial motion capture technology
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9549283/
https://www.ncbi.nlm.nih.gov/pubmed/36225260
http://dx.doi.org/10.3389/fnbot.2022.922756
work_keys_str_mv AT zhushengyin researchonthedynamicvisemeofthelipshapebasedonfacialmotioncapturetechnology