Cargando…

Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks

Background: Williams-Beuren syndrome (WBS) is a rare genetic syndrome with a characteristic “elfin” facial gestalt. The “elfin” facial characteristics include a broad forehead, periorbital puffiness, flat nasal bridge, short upturned nose, wide mouth, thick lips, and pointed chin. Recently, deep con...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Hui, Mo, Zi-Hua, Yang, Hang, Zhang, Zheng-Fu, Hong, Dian, Wen, Long, Lin, Min-Yin, Zheng, Ying-Yi, Zhang, Zhi-Wei, Xu, Xiao-Wei, Zhuang, Jian, Wang, Shu-Shui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8170407/
https://www.ncbi.nlm.nih.gov/pubmed/34095025
http://dx.doi.org/10.3389/fped.2021.648255
_version_ 1783702236997615616
author Liu, Hui
Mo, Zi-Hua
Yang, Hang
Zhang, Zheng-Fu
Hong, Dian
Wen, Long
Lin, Min-Yin
Zheng, Ying-Yi
Zhang, Zhi-Wei
Xu, Xiao-Wei
Zhuang, Jian
Wang, Shu-Shui
author_facet Liu, Hui
Mo, Zi-Hua
Yang, Hang
Zhang, Zheng-Fu
Hong, Dian
Wen, Long
Lin, Min-Yin
Zheng, Ying-Yi
Zhang, Zhi-Wei
Xu, Xiao-Wei
Zhuang, Jian
Wang, Shu-Shui
author_sort Liu, Hui
collection PubMed
description Background: Williams-Beuren syndrome (WBS) is a rare genetic syndrome with a characteristic “elfin” facial gestalt. The “elfin” facial characteristics include a broad forehead, periorbital puffiness, flat nasal bridge, short upturned nose, wide mouth, thick lips, and pointed chin. Recently, deep convolutional neural networks (CNNs) have been successfully applied to facial recognition for diagnosing genetic syndromes. However, there is little research on WBS facial recognition using deep CNNs. Objective: The purpose of this study was to construct an automatic facial recognition model for WBS diagnosis based on deep CNNs. Methods: The study enrolled 104 WBS children, 91 cases with other genetic syndromes, and 145 healthy children. The photo dataset used only one frontal facial photo from each participant. Five face recognition frameworks for WBS were constructed by adopting the VGG-16, VGG-19, ResNet-18, ResNet-34, and MobileNet-V2 architectures, respectively. ImageNet transfer learning was used to avoid over-fitting. The classification performance of the facial recognition models was assessed by five-fold cross validation, and comparison with human experts was performed. Results: The five face recognition frameworks for WBS were constructed. The VGG-19 model achieved the best performance. The accuracy, precision, recall, F1 score, and area under curve (AUC) of the VGG-19 model were 92.7 ± 1.3%, 94.0 ± 5.6%, 81.7 ± 3.6%, 87.2 ± 2.0%, and 89.6 ± 1.3%, respectively. The highest accuracy, precision, recall, F1 score, and AUC of human experts were 82.1, 65.9, 85.6, 74.5, and 83.0%, respectively. The AUCs of each human expert were inferior to the AUCs of the VGG-16 (88.6 ± 3.5%), VGG-19 (89.6 ± 1.3%), ResNet-18 (83.6 ± 8.2%), and ResNet-34 (86.3 ± 4.9%) models. Conclusions: This study highlighted the possibility of using deep CNNs for diagnosing WBS in clinical practice. The facial recognition framework based on VGG-19 could play a prominent role in WBS diagnosis. Transfer learning technology can help to construct facial recognition models of genetic syndromes with small-scale datasets.
format Online
Article
Text
id pubmed-8170407
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-81704072021-06-03 Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks Liu, Hui Mo, Zi-Hua Yang, Hang Zhang, Zheng-Fu Hong, Dian Wen, Long Lin, Min-Yin Zheng, Ying-Yi Zhang, Zhi-Wei Xu, Xiao-Wei Zhuang, Jian Wang, Shu-Shui Front Pediatr Pediatrics Background: Williams-Beuren syndrome (WBS) is a rare genetic syndrome with a characteristic “elfin” facial gestalt. The “elfin” facial characteristics include a broad forehead, periorbital puffiness, flat nasal bridge, short upturned nose, wide mouth, thick lips, and pointed chin. Recently, deep convolutional neural networks (CNNs) have been successfully applied to facial recognition for diagnosing genetic syndromes. However, there is little research on WBS facial recognition using deep CNNs. Objective: The purpose of this study was to construct an automatic facial recognition model for WBS diagnosis based on deep CNNs. Methods: The study enrolled 104 WBS children, 91 cases with other genetic syndromes, and 145 healthy children. The photo dataset used only one frontal facial photo from each participant. Five face recognition frameworks for WBS were constructed by adopting the VGG-16, VGG-19, ResNet-18, ResNet-34, and MobileNet-V2 architectures, respectively. ImageNet transfer learning was used to avoid over-fitting. The classification performance of the facial recognition models was assessed by five-fold cross validation, and comparison with human experts was performed. Results: The five face recognition frameworks for WBS were constructed. The VGG-19 model achieved the best performance. The accuracy, precision, recall, F1 score, and area under curve (AUC) of the VGG-19 model were 92.7 ± 1.3%, 94.0 ± 5.6%, 81.7 ± 3.6%, 87.2 ± 2.0%, and 89.6 ± 1.3%, respectively. The highest accuracy, precision, recall, F1 score, and AUC of human experts were 82.1, 65.9, 85.6, 74.5, and 83.0%, respectively. The AUCs of each human expert were inferior to the AUCs of the VGG-16 (88.6 ± 3.5%), VGG-19 (89.6 ± 1.3%), ResNet-18 (83.6 ± 8.2%), and ResNet-34 (86.3 ± 4.9%) models. Conclusions: This study highlighted the possibility of using deep CNNs for diagnosing WBS in clinical practice. The facial recognition framework based on VGG-19 could play a prominent role in WBS diagnosis. Transfer learning technology can help to construct facial recognition models of genetic syndromes with small-scale datasets. Frontiers Media S.A. 2021-05-19 /pmc/articles/PMC8170407/ /pubmed/34095025 http://dx.doi.org/10.3389/fped.2021.648255 Text en Copyright © 2021 Liu, Mo, Yang, Zhang, Hong, Wen, Lin, Zheng, Zhang, Xu, Zhuang and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Pediatrics
Liu, Hui
Mo, Zi-Hua
Yang, Hang
Zhang, Zheng-Fu
Hong, Dian
Wen, Long
Lin, Min-Yin
Zheng, Ying-Yi
Zhang, Zhi-Wei
Xu, Xiao-Wei
Zhuang, Jian
Wang, Shu-Shui
Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks
title Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks
title_full Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks
title_fullStr Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks
title_full_unstemmed Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks
title_short Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks
title_sort automatic facial recognition of williams-beuren syndrome based on deep convolutional neural networks
topic Pediatrics
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8170407/
https://www.ncbi.nlm.nih.gov/pubmed/34095025
http://dx.doi.org/10.3389/fped.2021.648255
work_keys_str_mv AT liuhui automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT mozihua automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT yanghang automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT zhangzhengfu automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT hongdian automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT wenlong automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT linminyin automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT zhengyingyi automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT zhangzhiwei automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT xuxiaowei automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT zhuangjian automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks
AT wangshushui automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks