Cargando…

Finding any Waldo with zero-shot invariant and efficient visual search

Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, an...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Mengmi, Feng, Jiashi, Ma, Keng Teck, Lim, Joo Hwee, Zhao, Qi, Kreiman, Gabriel
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6137219/
https://www.ncbi.nlm.nih.gov/pubmed/30213937
http://dx.doi.org/10.1038/s41467-018-06217-x
_version_ 1783355143594442752
author Zhang, Mengmi
Feng, Jiashi
Ma, Keng Teck
Lim, Joo Hwee
Zhao, Qi
Kreiman, Gabriel
author_facet Zhang, Mengmi
Feng, Jiashi
Ma, Keng Teck
Lim, Joo Hwee
Zhao, Qi
Kreiman, Gabriel
author_sort Zhang, Mengmi
collection PubMed
description Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work on visual search has focused on searching for perfect matches of a target after extensive category-specific training. Here, we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and which can generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes.
format Online
Article
Text
id pubmed-6137219
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-61372192018-09-17 Finding any Waldo with zero-shot invariant and efficient visual search Zhang, Mengmi Feng, Jiashi Ma, Keng Teck Lim, Joo Hwee Zhao, Qi Kreiman, Gabriel Nat Commun Article Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work on visual search has focused on searching for perfect matches of a target after extensive category-specific training. Here, we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and which can generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes. Nature Publishing Group UK 2018-09-13 /pmc/articles/PMC6137219/ /pubmed/30213937 http://dx.doi.org/10.1038/s41467-018-06217-x Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Zhang, Mengmi
Feng, Jiashi
Ma, Keng Teck
Lim, Joo Hwee
Zhao, Qi
Kreiman, Gabriel
Finding any Waldo with zero-shot invariant and efficient visual search
title Finding any Waldo with zero-shot invariant and efficient visual search
title_full Finding any Waldo with zero-shot invariant and efficient visual search
title_fullStr Finding any Waldo with zero-shot invariant and efficient visual search
title_full_unstemmed Finding any Waldo with zero-shot invariant and efficient visual search
title_short Finding any Waldo with zero-shot invariant and efficient visual search
title_sort finding any waldo with zero-shot invariant and efficient visual search
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6137219/
https://www.ncbi.nlm.nih.gov/pubmed/30213937
http://dx.doi.org/10.1038/s41467-018-06217-x
work_keys_str_mv AT zhangmengmi findinganywaldowithzeroshotinvariantandefficientvisualsearch
AT fengjiashi findinganywaldowithzeroshotinvariantandefficientvisualsearch
AT makengteck findinganywaldowithzeroshotinvariantandefficientvisualsearch
AT limjoohwee findinganywaldowithzeroshotinvariantandefficientvisualsearch
AT zhaoqi findinganywaldowithzeroshotinvariantandefficientvisualsearch
AT kreimangabriel findinganywaldowithzeroshotinvariantandefficientvisualsearch