Cargando…

SEALNET: Facial recognition software for ecological studies of harbor seals

Methods for long‐term monitoring of coastal species such as harbor seals (Phoca vitulina) are often costly, time‐consuming, and highly invasive, underscoring the need for improved techniques for data collection and analysis. Here, we propose the use of automated facial recognition technology for ide...

Descripción completa

Detalles Bibliográficos
Autores principales: Birenbaum, Zach, Do, Hieu, Horstmyer, Lauren, Orff, Hailey, Ingram, Krista, Ay, Ahmet
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9047973/
https://www.ncbi.nlm.nih.gov/pubmed/35505998
http://dx.doi.org/10.1002/ece3.8851
_version_ 1784695839750356992
author Birenbaum, Zach
Do, Hieu
Horstmyer, Lauren
Orff, Hailey
Ingram, Krista
Ay, Ahmet
author_facet Birenbaum, Zach
Do, Hieu
Horstmyer, Lauren
Orff, Hailey
Ingram, Krista
Ay, Ahmet
author_sort Birenbaum, Zach
collection PubMed
description Methods for long‐term monitoring of coastal species such as harbor seals (Phoca vitulina) are often costly, time‐consuming, and highly invasive, underscoring the need for improved techniques for data collection and analysis. Here, we propose the use of automated facial recognition technology for identification of individual seals and demonstrate its utility in ecological and population studies. We created a software package, SealNet, that automates photo identification of seals, using a graphical user interface (GUI) software to detect, align, and chip seal faces from photographs and a deep convolutional neural network (CNN) suitable for small datasets (e.g., 100 seals with five photos per seal) to classify individual seals. We piloted the SealNet technology with a population of harbor seals located within Casco Bay on the coast of Maine, USA. Across two years of sampling, 2019 and 2020, at seven haul‐out sites in Middle Bay, we obtained a dataset optimized for the development and testing of SealNet. We processed 1752 images representing 408 individual seals and achieved 88% Rank‐1 and 96% Rank‐5 accuracy in closed set seal identification. In identifying individual seals, SealNet software outperformed a similar face recognition method, PrimNet, developed for primates but retrained on seals. The ease and wealth of image data that can be processed using SealNet software contributes a vital tool for ecological and behavioral studies of marine mammals in the developing field of conservation technology.
format Online
Article
Text
id pubmed-9047973
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-90479732022-05-02 SEALNET: Facial recognition software for ecological studies of harbor seals Birenbaum, Zach Do, Hieu Horstmyer, Lauren Orff, Hailey Ingram, Krista Ay, Ahmet Ecol Evol Research Articles Methods for long‐term monitoring of coastal species such as harbor seals (Phoca vitulina) are often costly, time‐consuming, and highly invasive, underscoring the need for improved techniques for data collection and analysis. Here, we propose the use of automated facial recognition technology for identification of individual seals and demonstrate its utility in ecological and population studies. We created a software package, SealNet, that automates photo identification of seals, using a graphical user interface (GUI) software to detect, align, and chip seal faces from photographs and a deep convolutional neural network (CNN) suitable for small datasets (e.g., 100 seals with five photos per seal) to classify individual seals. We piloted the SealNet technology with a population of harbor seals located within Casco Bay on the coast of Maine, USA. Across two years of sampling, 2019 and 2020, at seven haul‐out sites in Middle Bay, we obtained a dataset optimized for the development and testing of SealNet. We processed 1752 images representing 408 individual seals and achieved 88% Rank‐1 and 96% Rank‐5 accuracy in closed set seal identification. In identifying individual seals, SealNet software outperformed a similar face recognition method, PrimNet, developed for primates but retrained on seals. The ease and wealth of image data that can be processed using SealNet software contributes a vital tool for ecological and behavioral studies of marine mammals in the developing field of conservation technology. John Wiley and Sons Inc. 2022-04-28 /pmc/articles/PMC9047973/ /pubmed/35505998 http://dx.doi.org/10.1002/ece3.8851 Text en © 2022 The Authors. Ecology and Evolution published by John Wiley & Sons Ltd. https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Articles
Birenbaum, Zach
Do, Hieu
Horstmyer, Lauren
Orff, Hailey
Ingram, Krista
Ay, Ahmet
SEALNET: Facial recognition software for ecological studies of harbor seals
title SEALNET: Facial recognition software for ecological studies of harbor seals
title_full SEALNET: Facial recognition software for ecological studies of harbor seals
title_fullStr SEALNET: Facial recognition software for ecological studies of harbor seals
title_full_unstemmed SEALNET: Facial recognition software for ecological studies of harbor seals
title_short SEALNET: Facial recognition software for ecological studies of harbor seals
title_sort sealnet: facial recognition software for ecological studies of harbor seals
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9047973/
https://www.ncbi.nlm.nih.gov/pubmed/35505998
http://dx.doi.org/10.1002/ece3.8851
work_keys_str_mv AT birenbaumzach sealnetfacialrecognitionsoftwareforecologicalstudiesofharborseals
AT dohieu sealnetfacialrecognitionsoftwareforecologicalstudiesofharborseals
AT horstmyerlauren sealnetfacialrecognitionsoftwareforecologicalstudiesofharborseals
AT orffhailey sealnetfacialrecognitionsoftwareforecologicalstudiesofharborseals
AT ingramkrista sealnetfacialrecognitionsoftwareforecologicalstudiesofharborseals
AT ayahmet sealnetfacialrecognitionsoftwareforecologicalstudiesofharborseals