Cargando…
Finding any Waldo with zero-shot invariant and efficient visual search
Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, an...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6137219/ https://www.ncbi.nlm.nih.gov/pubmed/30213937 http://dx.doi.org/10.1038/s41467-018-06217-x |
_version_ | 1783355143594442752 |
---|---|
author | Zhang, Mengmi Feng, Jiashi Ma, Keng Teck Lim, Joo Hwee Zhao, Qi Kreiman, Gabriel |
author_facet | Zhang, Mengmi Feng, Jiashi Ma, Keng Teck Lim, Joo Hwee Zhao, Qi Kreiman, Gabriel |
author_sort | Zhang, Mengmi |
collection | PubMed |
description | Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work on visual search has focused on searching for perfect matches of a target after extensive category-specific training. Here, we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and which can generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes. |
format | Online Article Text |
id | pubmed-6137219 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-61372192018-09-17 Finding any Waldo with zero-shot invariant and efficient visual search Zhang, Mengmi Feng, Jiashi Ma, Keng Teck Lim, Joo Hwee Zhao, Qi Kreiman, Gabriel Nat Commun Article Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work on visual search has focused on searching for perfect matches of a target after extensive category-specific training. Here, we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and which can generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes. Nature Publishing Group UK 2018-09-13 /pmc/articles/PMC6137219/ /pubmed/30213937 http://dx.doi.org/10.1038/s41467-018-06217-x Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Zhang, Mengmi Feng, Jiashi Ma, Keng Teck Lim, Joo Hwee Zhao, Qi Kreiman, Gabriel Finding any Waldo with zero-shot invariant and efficient visual search |
title | Finding any Waldo with zero-shot invariant and efficient visual search |
title_full | Finding any Waldo with zero-shot invariant and efficient visual search |
title_fullStr | Finding any Waldo with zero-shot invariant and efficient visual search |
title_full_unstemmed | Finding any Waldo with zero-shot invariant and efficient visual search |
title_short | Finding any Waldo with zero-shot invariant and efficient visual search |
title_sort | finding any waldo with zero-shot invariant and efficient visual search |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6137219/ https://www.ncbi.nlm.nih.gov/pubmed/30213937 http://dx.doi.org/10.1038/s41467-018-06217-x |
work_keys_str_mv | AT zhangmengmi findinganywaldowithzeroshotinvariantandefficientvisualsearch AT fengjiashi findinganywaldowithzeroshotinvariantandefficientvisualsearch AT makengteck findinganywaldowithzeroshotinvariantandefficientvisualsearch AT limjoohwee findinganywaldowithzeroshotinvariantandefficientvisualsearch AT zhaoqi findinganywaldowithzeroshotinvariantandefficientvisualsearch AT kreimangabriel findinganywaldowithzeroshotinvariantandefficientvisualsearch |