Cargando…

Bi-FPNFAS: Bi-Directional Feature Pyramid Network for Pixel-Wise Face Anti-Spoofing by Leveraging Fourier Spectra

The emergence of biometric-based authentication using modern sensors on electronic devices has led to an escalated use of face recognition technologies. While these technologies may seem intriguing, they are accompanied by numerous implicit drawbacks. In this paper, we look into the problem of face...

Descripción completa

Detalles Bibliográficos
Autores principales: Roy, Koushik, Hasan, Md., Rupty, Labiba, Hossain, Md. Sourave, Sengupta, Shirshajit, Taus, Shehzad Noor, Mohammed, Nabeel
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8071535/
https://www.ncbi.nlm.nih.gov/pubmed/33921140
http://dx.doi.org/10.3390/s21082799
_version_ 1783683731078250496
author Roy, Koushik
Hasan, Md.
Rupty, Labiba
Hossain, Md. Sourave
Sengupta, Shirshajit
Taus, Shehzad Noor
Mohammed, Nabeel
author_facet Roy, Koushik
Hasan, Md.
Rupty, Labiba
Hossain, Md. Sourave
Sengupta, Shirshajit
Taus, Shehzad Noor
Mohammed, Nabeel
author_sort Roy, Koushik
collection PubMed
description The emergence of biometric-based authentication using modern sensors on electronic devices has led to an escalated use of face recognition technologies. While these technologies may seem intriguing, they are accompanied by numerous implicit drawbacks. In this paper, we look into the problem of face anti-spoofing (FAS) on a frame level in an attempt to ameliorate the risks of face-spoofed attacks in biometric authentication processes. We employed a bi-directional feature pyramid network (BiFPN) that is used for convolutional multi-scaled feature extraction on the EfficientDet detection architecture, which is novel to the task of FAS. We further use these convolutional multi-scaled features in order to perform deep pixel-wise supervision. For all of our experiments, we performed evaluations across all major datasets and attained competitive results for the majority of the cases. Additionally, we showed that introducing an auxiliary self-supervision branch tasked with reconstructing the inputs in the frequency domain demonstrates an average classification error rate (ACER) of 2.92% on Protocol IV of the OULU-NPU dataset, which is significantly better than the currently available published works on pixel-wise face anti-spoofing. Moreover, following the procedures of prior works, we performed inter-dataset testing, which further consolidated the generalizability of the proposed models, as they showed optimum results across various sensors without any fine-tuning procedures.
format Online
Article
Text
id pubmed-8071535
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-80715352021-04-26 Bi-FPNFAS: Bi-Directional Feature Pyramid Network for Pixel-Wise Face Anti-Spoofing by Leveraging Fourier Spectra Roy, Koushik Hasan, Md. Rupty, Labiba Hossain, Md. Sourave Sengupta, Shirshajit Taus, Shehzad Noor Mohammed, Nabeel Sensors (Basel) Article The emergence of biometric-based authentication using modern sensors on electronic devices has led to an escalated use of face recognition technologies. While these technologies may seem intriguing, they are accompanied by numerous implicit drawbacks. In this paper, we look into the problem of face anti-spoofing (FAS) on a frame level in an attempt to ameliorate the risks of face-spoofed attacks in biometric authentication processes. We employed a bi-directional feature pyramid network (BiFPN) that is used for convolutional multi-scaled feature extraction on the EfficientDet detection architecture, which is novel to the task of FAS. We further use these convolutional multi-scaled features in order to perform deep pixel-wise supervision. For all of our experiments, we performed evaluations across all major datasets and attained competitive results for the majority of the cases. Additionally, we showed that introducing an auxiliary self-supervision branch tasked with reconstructing the inputs in the frequency domain demonstrates an average classification error rate (ACER) of 2.92% on Protocol IV of the OULU-NPU dataset, which is significantly better than the currently available published works on pixel-wise face anti-spoofing. Moreover, following the procedures of prior works, we performed inter-dataset testing, which further consolidated the generalizability of the proposed models, as they showed optimum results across various sensors without any fine-tuning procedures. MDPI 2021-04-15 /pmc/articles/PMC8071535/ /pubmed/33921140 http://dx.doi.org/10.3390/s21082799 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Roy, Koushik
Hasan, Md.
Rupty, Labiba
Hossain, Md. Sourave
Sengupta, Shirshajit
Taus, Shehzad Noor
Mohammed, Nabeel
Bi-FPNFAS: Bi-Directional Feature Pyramid Network for Pixel-Wise Face Anti-Spoofing by Leveraging Fourier Spectra
title Bi-FPNFAS: Bi-Directional Feature Pyramid Network for Pixel-Wise Face Anti-Spoofing by Leveraging Fourier Spectra
title_full Bi-FPNFAS: Bi-Directional Feature Pyramid Network for Pixel-Wise Face Anti-Spoofing by Leveraging Fourier Spectra
title_fullStr Bi-FPNFAS: Bi-Directional Feature Pyramid Network for Pixel-Wise Face Anti-Spoofing by Leveraging Fourier Spectra
title_full_unstemmed Bi-FPNFAS: Bi-Directional Feature Pyramid Network for Pixel-Wise Face Anti-Spoofing by Leveraging Fourier Spectra
title_short Bi-FPNFAS: Bi-Directional Feature Pyramid Network for Pixel-Wise Face Anti-Spoofing by Leveraging Fourier Spectra
title_sort bi-fpnfas: bi-directional feature pyramid network for pixel-wise face anti-spoofing by leveraging fourier spectra
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8071535/
https://www.ncbi.nlm.nih.gov/pubmed/33921140
http://dx.doi.org/10.3390/s21082799
work_keys_str_mv AT roykoushik bifpnfasbidirectionalfeaturepyramidnetworkforpixelwisefaceantispoofingbyleveragingfourierspectra
AT hasanmd bifpnfasbidirectionalfeaturepyramidnetworkforpixelwisefaceantispoofingbyleveragingfourierspectra
AT ruptylabiba bifpnfasbidirectionalfeaturepyramidnetworkforpixelwisefaceantispoofingbyleveragingfourierspectra
AT hossainmdsourave bifpnfasbidirectionalfeaturepyramidnetworkforpixelwisefaceantispoofingbyleveragingfourierspectra
AT senguptashirshajit bifpnfasbidirectionalfeaturepyramidnetworkforpixelwisefaceantispoofingbyleveragingfourierspectra
AT tausshehzadnoor bifpnfasbidirectionalfeaturepyramidnetworkforpixelwisefaceantispoofingbyleveragingfourierspectra
AT mohammednabeel bifpnfasbidirectionalfeaturepyramidnetworkforpixelwisefaceantispoofingbyleveragingfourierspectra