Cargando…

Reassessing hierarchical correspondences between brain and deep networks through direct interface

Functional correspondences between deep convolutional neural networks (DCNNs) and the mammalian visual system support a hierarchical account in which successive stages of processing contain ever higher-level information. However, these correspondences between brain and model activity involve shared,...

Descripción completa

Detalles Bibliográficos
Autores principales: Sexton, Nicholas J., Love, Bradley C.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Association for the Advancement of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9278854/
https://www.ncbi.nlm.nih.gov/pubmed/35857493
http://dx.doi.org/10.1126/sciadv.abm2219
Descripción
Sumario:Functional correspondences between deep convolutional neural networks (DCNNs) and the mammalian visual system support a hierarchical account in which successive stages of processing contain ever higher-level information. However, these correspondences between brain and model activity involve shared, not task-relevant, variance. We propose a stricter account of correspondence: If a DCNN layer corresponds to a brain region, then replacing model activity with brain activity should successfully drive the DCNN’s object recognition decision. Using this approach on three datasets, we found that all regions along the ventral visual stream best corresponded with later model layers, indicating that all stages of processing contained higher-level information about object category. Time course analyses suggest that long-range recurrent connections transmit object class information from late to early visual areas.