Cargando…
Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks
Background: Williams-Beuren syndrome (WBS) is a rare genetic syndrome with a characteristic “elfin” facial gestalt. The “elfin” facial characteristics include a broad forehead, periorbital puffiness, flat nasal bridge, short upturned nose, wide mouth, thick lips, and pointed chin. Recently, deep con...
Autores principales: | , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8170407/ https://www.ncbi.nlm.nih.gov/pubmed/34095025 http://dx.doi.org/10.3389/fped.2021.648255 |
_version_ | 1783702236997615616 |
---|---|
author | Liu, Hui Mo, Zi-Hua Yang, Hang Zhang, Zheng-Fu Hong, Dian Wen, Long Lin, Min-Yin Zheng, Ying-Yi Zhang, Zhi-Wei Xu, Xiao-Wei Zhuang, Jian Wang, Shu-Shui |
author_facet | Liu, Hui Mo, Zi-Hua Yang, Hang Zhang, Zheng-Fu Hong, Dian Wen, Long Lin, Min-Yin Zheng, Ying-Yi Zhang, Zhi-Wei Xu, Xiao-Wei Zhuang, Jian Wang, Shu-Shui |
author_sort | Liu, Hui |
collection | PubMed |
description | Background: Williams-Beuren syndrome (WBS) is a rare genetic syndrome with a characteristic “elfin” facial gestalt. The “elfin” facial characteristics include a broad forehead, periorbital puffiness, flat nasal bridge, short upturned nose, wide mouth, thick lips, and pointed chin. Recently, deep convolutional neural networks (CNNs) have been successfully applied to facial recognition for diagnosing genetic syndromes. However, there is little research on WBS facial recognition using deep CNNs. Objective: The purpose of this study was to construct an automatic facial recognition model for WBS diagnosis based on deep CNNs. Methods: The study enrolled 104 WBS children, 91 cases with other genetic syndromes, and 145 healthy children. The photo dataset used only one frontal facial photo from each participant. Five face recognition frameworks for WBS were constructed by adopting the VGG-16, VGG-19, ResNet-18, ResNet-34, and MobileNet-V2 architectures, respectively. ImageNet transfer learning was used to avoid over-fitting. The classification performance of the facial recognition models was assessed by five-fold cross validation, and comparison with human experts was performed. Results: The five face recognition frameworks for WBS were constructed. The VGG-19 model achieved the best performance. The accuracy, precision, recall, F1 score, and area under curve (AUC) of the VGG-19 model were 92.7 ± 1.3%, 94.0 ± 5.6%, 81.7 ± 3.6%, 87.2 ± 2.0%, and 89.6 ± 1.3%, respectively. The highest accuracy, precision, recall, F1 score, and AUC of human experts were 82.1, 65.9, 85.6, 74.5, and 83.0%, respectively. The AUCs of each human expert were inferior to the AUCs of the VGG-16 (88.6 ± 3.5%), VGG-19 (89.6 ± 1.3%), ResNet-18 (83.6 ± 8.2%), and ResNet-34 (86.3 ± 4.9%) models. Conclusions: This study highlighted the possibility of using deep CNNs for diagnosing WBS in clinical practice. The facial recognition framework based on VGG-19 could play a prominent role in WBS diagnosis. Transfer learning technology can help to construct facial recognition models of genetic syndromes with small-scale datasets. |
format | Online Article Text |
id | pubmed-8170407 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-81704072021-06-03 Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks Liu, Hui Mo, Zi-Hua Yang, Hang Zhang, Zheng-Fu Hong, Dian Wen, Long Lin, Min-Yin Zheng, Ying-Yi Zhang, Zhi-Wei Xu, Xiao-Wei Zhuang, Jian Wang, Shu-Shui Front Pediatr Pediatrics Background: Williams-Beuren syndrome (WBS) is a rare genetic syndrome with a characteristic “elfin” facial gestalt. The “elfin” facial characteristics include a broad forehead, periorbital puffiness, flat nasal bridge, short upturned nose, wide mouth, thick lips, and pointed chin. Recently, deep convolutional neural networks (CNNs) have been successfully applied to facial recognition for diagnosing genetic syndromes. However, there is little research on WBS facial recognition using deep CNNs. Objective: The purpose of this study was to construct an automatic facial recognition model for WBS diagnosis based on deep CNNs. Methods: The study enrolled 104 WBS children, 91 cases with other genetic syndromes, and 145 healthy children. The photo dataset used only one frontal facial photo from each participant. Five face recognition frameworks for WBS were constructed by adopting the VGG-16, VGG-19, ResNet-18, ResNet-34, and MobileNet-V2 architectures, respectively. ImageNet transfer learning was used to avoid over-fitting. The classification performance of the facial recognition models was assessed by five-fold cross validation, and comparison with human experts was performed. Results: The five face recognition frameworks for WBS were constructed. The VGG-19 model achieved the best performance. The accuracy, precision, recall, F1 score, and area under curve (AUC) of the VGG-19 model were 92.7 ± 1.3%, 94.0 ± 5.6%, 81.7 ± 3.6%, 87.2 ± 2.0%, and 89.6 ± 1.3%, respectively. The highest accuracy, precision, recall, F1 score, and AUC of human experts were 82.1, 65.9, 85.6, 74.5, and 83.0%, respectively. The AUCs of each human expert were inferior to the AUCs of the VGG-16 (88.6 ± 3.5%), VGG-19 (89.6 ± 1.3%), ResNet-18 (83.6 ± 8.2%), and ResNet-34 (86.3 ± 4.9%) models. Conclusions: This study highlighted the possibility of using deep CNNs for diagnosing WBS in clinical practice. The facial recognition framework based on VGG-19 could play a prominent role in WBS diagnosis. Transfer learning technology can help to construct facial recognition models of genetic syndromes with small-scale datasets. Frontiers Media S.A. 2021-05-19 /pmc/articles/PMC8170407/ /pubmed/34095025 http://dx.doi.org/10.3389/fped.2021.648255 Text en Copyright © 2021 Liu, Mo, Yang, Zhang, Hong, Wen, Lin, Zheng, Zhang, Xu, Zhuang and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Pediatrics Liu, Hui Mo, Zi-Hua Yang, Hang Zhang, Zheng-Fu Hong, Dian Wen, Long Lin, Min-Yin Zheng, Ying-Yi Zhang, Zhi-Wei Xu, Xiao-Wei Zhuang, Jian Wang, Shu-Shui Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks |
title | Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks |
title_full | Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks |
title_fullStr | Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks |
title_full_unstemmed | Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks |
title_short | Automatic Facial Recognition of Williams-Beuren Syndrome Based on Deep Convolutional Neural Networks |
title_sort | automatic facial recognition of williams-beuren syndrome based on deep convolutional neural networks |
topic | Pediatrics |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8170407/ https://www.ncbi.nlm.nih.gov/pubmed/34095025 http://dx.doi.org/10.3389/fped.2021.648255 |
work_keys_str_mv | AT liuhui automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT mozihua automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT yanghang automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT zhangzhengfu automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT hongdian automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT wenlong automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT linminyin automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT zhengyingyi automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT zhangzhiwei automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT xuxiaowei automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT zhuangjian automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks AT wangshushui automaticfacialrecognitionofwilliamsbeurensyndromebasedondeepconvolutionalneuralnetworks |