Cargando…

A data-driven investigation of human action representations

Understanding actions performed by others requires us to integrate different types of information about people, scenes, objects, and their interactions. What organizing dimensions does the mind use to make sense of this complex action space? To address this question, we collected intuitive similarit...

Descripción completa

Detalles Bibliográficos
Autores principales: Dima, Diana C., Hebart, Martin N., Isik, Leyla
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10063663/
https://www.ncbi.nlm.nih.gov/pubmed/36997625
http://dx.doi.org/10.1038/s41598-023-32192-5
_version_ 1785017753595281408
author Dima, Diana C.
Hebart, Martin N.
Isik, Leyla
author_facet Dima, Diana C.
Hebart, Martin N.
Isik, Leyla
author_sort Dima, Diana C.
collection PubMed
description Understanding actions performed by others requires us to integrate different types of information about people, scenes, objects, and their interactions. What organizing dimensions does the mind use to make sense of this complex action space? To address this question, we collected intuitive similarity judgments across two large-scale sets of naturalistic videos depicting everyday actions. We used cross-validated sparse non-negative matrix factorization to identify the structure underlying action similarity judgments. A low-dimensional representation, consisting of nine to ten dimensions, was sufficient to accurately reconstruct human similarity judgments. The dimensions were robust to stimulus set perturbations and reproducible in a separate odd-one-out experiment. Human labels mapped these dimensions onto semantic axes relating to food, work, and home life; social axes relating to people and emotions; and one visual axis related to scene setting. While highly interpretable, these dimensions did not share a clear one-to-one correspondence with prior hypotheses of action-relevant dimensions. Together, our results reveal a low-dimensional set of robust and interpretable dimensions that organize intuitive action similarity judgments and highlight the importance of data-driven investigations of behavioral representations.
format Online
Article
Text
id pubmed-10063663
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-100636632023-04-01 A data-driven investigation of human action representations Dima, Diana C. Hebart, Martin N. Isik, Leyla Sci Rep Article Understanding actions performed by others requires us to integrate different types of information about people, scenes, objects, and their interactions. What organizing dimensions does the mind use to make sense of this complex action space? To address this question, we collected intuitive similarity judgments across two large-scale sets of naturalistic videos depicting everyday actions. We used cross-validated sparse non-negative matrix factorization to identify the structure underlying action similarity judgments. A low-dimensional representation, consisting of nine to ten dimensions, was sufficient to accurately reconstruct human similarity judgments. The dimensions were robust to stimulus set perturbations and reproducible in a separate odd-one-out experiment. Human labels mapped these dimensions onto semantic axes relating to food, work, and home life; social axes relating to people and emotions; and one visual axis related to scene setting. While highly interpretable, these dimensions did not share a clear one-to-one correspondence with prior hypotheses of action-relevant dimensions. Together, our results reveal a low-dimensional set of robust and interpretable dimensions that organize intuitive action similarity judgments and highlight the importance of data-driven investigations of behavioral representations. Nature Publishing Group UK 2023-03-30 /pmc/articles/PMC10063663/ /pubmed/36997625 http://dx.doi.org/10.1038/s41598-023-32192-5 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Dima, Diana C.
Hebart, Martin N.
Isik, Leyla
A data-driven investigation of human action representations
title A data-driven investigation of human action representations
title_full A data-driven investigation of human action representations
title_fullStr A data-driven investigation of human action representations
title_full_unstemmed A data-driven investigation of human action representations
title_short A data-driven investigation of human action representations
title_sort data-driven investigation of human action representations
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10063663/
https://www.ncbi.nlm.nih.gov/pubmed/36997625
http://dx.doi.org/10.1038/s41598-023-32192-5
work_keys_str_mv AT dimadianac adatadriveninvestigationofhumanactionrepresentations
AT hebartmartinn adatadriveninvestigationofhumanactionrepresentations
AT isikleyla adatadriveninvestigationofhumanactionrepresentations
AT dimadianac datadriveninvestigationofhumanactionrepresentations
AT hebartmartinn datadriveninvestigationofhumanactionrepresentations
AT isikleyla datadriveninvestigationofhumanactionrepresentations