Cargando…

Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns

This study was carried out with the aim of exploring the full-convolution Siamese network (SiamFC) in the application of neonatal facial video image tracking, achieving accurate recognition of neonatal pain and helping doctors evaluate neonatal emotions in an automatic manner. The current technology...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Yun, Huang, Lu, Yee, Austin Lin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8972989/
https://www.ncbi.nlm.nih.gov/pubmed/35382385
http://dx.doi.org/10.1007/s11227-022-04439-x
_version_ 1784679966136336384
author Wang, Yun
Huang, Lu
Yee, Austin Lin
author_facet Wang, Yun
Huang, Lu
Yee, Austin Lin
author_sort Wang, Yun
collection PubMed
description This study was carried out with the aim of exploring the full-convolution Siamese network (SiamFC) in the application of neonatal facial video image tracking, achieving accurate recognition of neonatal pain and helping doctors evaluate neonatal emotions in an automatic manner. The current technology shows low accuracy on facial image recognition of newborns, so the SiamFC algorithm under the deep learning was optimized in this study. Besides, a newborn facial video image tracking model (FVIT model) was constructed based on the SiamFC algorithm in combination with the attention mechanism with face tracking algorithm, and the facial features of newborns were tracked and recognized. In addition, a newborn face database was constructed based on the adult face database to evaluate performance of the FVIT model. It was found that the accuracy of the improved algorithm is 0.889, higher by 0.036 in contrast to other models; the area under the curve (AUC) of success rate reaches 0.748, higher by 0.075 compared with other algorithms. What’s more, the improved algorithm shows good performance in tracking the facial occlusion, facial expression changes, and scale conversion of newborns. Therefore, the improved algorithm shows higher accuracy and success rate and has good effect in capturing and tracking the facial images of newborns, thereby providing an experimental basis for facial recognition and pain assessment of newborns in the later stage.
format Online
Article
Text
id pubmed-8972989
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-89729892022-04-01 Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns Wang, Yun Huang, Lu Yee, Austin Lin J Supercomput Article This study was carried out with the aim of exploring the full-convolution Siamese network (SiamFC) in the application of neonatal facial video image tracking, achieving accurate recognition of neonatal pain and helping doctors evaluate neonatal emotions in an automatic manner. The current technology shows low accuracy on facial image recognition of newborns, so the SiamFC algorithm under the deep learning was optimized in this study. Besides, a newborn facial video image tracking model (FVIT model) was constructed based on the SiamFC algorithm in combination with the attention mechanism with face tracking algorithm, and the facial features of newborns were tracked and recognized. In addition, a newborn face database was constructed based on the adult face database to evaluate performance of the FVIT model. It was found that the accuracy of the improved algorithm is 0.889, higher by 0.036 in contrast to other models; the area under the curve (AUC) of success rate reaches 0.748, higher by 0.075 compared with other algorithms. What’s more, the improved algorithm shows good performance in tracking the facial occlusion, facial expression changes, and scale conversion of newborns. Therefore, the improved algorithm shows higher accuracy and success rate and has good effect in capturing and tracking the facial images of newborns, thereby providing an experimental basis for facial recognition and pain assessment of newborns in the later stage. Springer US 2022-04-01 2022 /pmc/articles/PMC8972989/ /pubmed/35382385 http://dx.doi.org/10.1007/s11227-022-04439-x Text en © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Wang, Yun
Huang, Lu
Yee, Austin Lin
Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns
title Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns
title_full Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns
title_fullStr Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns
title_full_unstemmed Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns
title_short Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns
title_sort full-convolution siamese network algorithm under deep learning used in tracking of facial video image in newborns
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8972989/
https://www.ncbi.nlm.nih.gov/pubmed/35382385
http://dx.doi.org/10.1007/s11227-022-04439-x
work_keys_str_mv AT wangyun fullconvolutionsiamesenetworkalgorithmunderdeeplearningusedintrackingoffacialvideoimageinnewborns
AT huanglu fullconvolutionsiamesenetworkalgorithmunderdeeplearningusedintrackingoffacialvideoimageinnewborns
AT yeeaustinlin fullconvolutionsiamesenetworkalgorithmunderdeeplearningusedintrackingoffacialvideoimageinnewborns